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Abstract 

We use fluid limits to explore the (in)stability properties of wireless networks with queue-based random-access 
algorithms. Queue-based random-access schemes are simple and inherently distributed in nature, yet provide the 
capability to match the optimal throughput performance of centralized scheduling mechanisms in a wide range of 
scenarios. Unfortunately, the type of activation rules for which throughput optimality has been established, may 
result in excessive queue lengths and delays. The use of more aggressive/persistent access schemes can improve the 
delay performance, but does not offer any universal maximum-stability guarantees. 

In order to gain qualitative insight and investigate the (in)stability properties of more aggressive/persistent 
activation rules, we examine fluid limits where the dynamics are scaled in space and time. In some situations, 
the fluid Umits have smooth deterministic features and maximum stability is maintained, while in other scenarios 
they exhibit random oscillatory characteristics, giving rise to major technical challenges. In the latter regime, more 
aggressive access schemes continue to provide maximum stability in some networks, but may cause instability in 
others. Simulation experiments are conducted to illustrate and validate the analytical results. 

L Introduction 

Emerging wireless mesh networks typically lack any centralized access control entity, and instead vitally rely 
on the individual nodes to operate autonomously and to efficiently share the medium in a distributed fashion. This 
requires the nodes to schedule their individual transmissions and decide on the use of a shared medium based on 
knowledge that is locally available or only involves limited exchange of information. A popular mechanism for 
distributed medium access control is provided by the so-called Carrier-Sense Multiple-Access (CSMA) protocol. 
In the CSMA protocol each node attempts to access the medium after a certain back-off time, but nodes that sense 
activity of interfering nodes freeze their back-off timer until the medium is sensed idle. While the CSMA protocol 
is fairly easy to understand at a local level, the interaction among interfering nodes gives rise to quite intricate 
behavior and complex throughput characteristics on a macroscopic scale. In recent years relatively parsimonious 
models have emerged that provide a useful tool in evaluating the throughput characteristics of CSMA-like networks, 
see for instance Q, JH, 191, p9|. Experimental results in Liew et al. 1.23.1 demonstrate that these models, while 
idealized, provide throughput estimates that match remarkably well with measurements in actual systems. 

Despite their asynchronous and distributed nature, CSMA-like algorithms have been shown to offer the remarkable 
capability of achieving the full capacity region and thus match the optimal throughput performance of centralized 
scheduling mechanisms operating in slotted time |[T9l . |[20l . ll24l . More specifically, any throughput vector in the 
interior of the convex hull associated with the independent sets in the underlying interference graph can be achieved 
through suitable back-off rates and/or transmission lengths. Based on this observation, various ingenious algorithms 
have been developed for finding the back-off rates that yield a particular target throughput vector or that optimize 
a certain concave throughput utility function in scenarios with saturated buffers llT9l . ll20l . \26\. In the same 
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spirit, several effective approaches have been devised for adapting the transmission lengths based on queue length 
information, and been shown to guarantee maximum stability ifTSll . ||29l . ll34ll . |[35l . 

Roughly speaking, the maximum-stability guarantees were estabUshed under the condition that the activity factors 
of the various nodes behave as logarithmic functions of the queue lengths. Unfortunately, such activity factors can 
induce excessive queue lengths and delays, which has triggered a strong interest in developing approaches for 
improving the delay performance OH, lEH, 123, 1281, ESl- Motivated by this issue, Ghaderi & Srikant OS 
recently showed that it is in fact sufficient for the logarithms of the activity factors to behave as logarithmic 
functions of the queue lengths, divided by an arbitrarily slowly increasing, unbounded function. These results 
indicate that the maximum- stability guarantees are preserved for activity functions that are essentially linear for all 
practical values of the queue lengths, although asymptotically the activity rate must grow slower than any positive 
power of the queue length. A careful inspection reveals that the proof arguments leave little room to weaken the 
stated growth condition. Since the growth condition is only a sufficient one, however, it is not clear to what extent 
it is actually a strict requirement for maximum stability to be maintained. 

In the present paper we explore the scope for using more aggressive activity functions in order to improve 
the delay performance while preserving the maximum-stability guarantees. Since the proof methods of ifTSl . |[T8]| . 
ll29l . ll34l . ll35l do not easily extend to more aggressive activity functions, we will instead adopt fluid limits 
where the dynamics of the system are scaled in both space and time. Fluid limits may be interpreted as first-order 
approximations of the original stochastic process, and provide valuable qualitative insight and a powerful approach 
for establishing (in)stability properties |5l|, ||6l, |^, [27|. 

As observed in [4j, qualitatively different types of fluid limits can arise, depending on the structure of the 
interference graph, in conjunction with the functional shape of the activity factors. For sufficiently tame activity 
functions as in |[T5l . ||29^, (34], f35], 'fast mixing' is guaranteed, where the activity process evolves on a much faster 
time scale than the scaled queue lengths. Qualitatively similar fluid limits can arise for more aggressive activity 
functions as well, provided the topology is benign in a certain sense, which implies that the maximum-stability 
guarantees are preserved in those cases. In different regimes, however, aggressive activity functions can cause 
'sluggish mixing', where the activity process evolves on a much slower time scale than the scaled queue lengths, 
yielding oscillatory fluid limits that follow random trajectories. It is highly unusual for such random dynamics to 
occur, as in queueing networks typically the random characteristics vanish and deterministic limits emerge on the 
fluid scale. A few exceptions are known for various polling-type models as considered in lfT3l . ||2T]| . |[T4l . 

The random nature of the fluid limits gives rise to several complications in the convergence proofs that are not 
commonly encountered. Since the random-access networks that we consider are fundamentally different from the 
polling type-models in the above-mentioned references, the fluid limits are qualitatively different as well, and require 
a substantially different approach to establish convergence. Specifically, we develop an approach based on stopping 
time sequences to deal with the switching probabilities governing the sample paths of the fluid limit process. While 
these proof arguments are developed in the context of random-access networks, several key components extend far 
beyond the scope of the present problem. Hence, we believe that the proof constructs are of broader methodological 
value in handling random fluid limits and of potential use in establishing both stability and instability results for a 
wider range of models. For example, the methodology that we develop could be easily applied to prove the stability 
results for the random capture scheme as conjectured in work of Feuillet et al. |[T2l . 

The possible oscillatory behavior of the fluid limit itself does not necessarily imply that the system is unstable, 
and in some situations maximum stability is in fact maintained. In other scenarios, however, the fluid limit reflects 
that more aggressive activity functions may force the system into inefficient states for extended periods of time 
and produce instability. We will demonstrate instability for super-linear activity functions, but our proof arguments 
suggest that it can potentially occur for any activity factor that grows as a positive power of the queue lengths in 
networks with sufficiently many nodes. In other words, the growth conditions for maximum stability depend on the 
number of nodes, which seems loosely related to results in [IJj, [36], [37] characterizing how (upper bounds for) 
the mean queue length and delay scale as a function of the size of the network. 

The remainder of the paper is organized as follows. In Section |llj we present a detailed model description. We 
introduce fluid limits and discuss the various qualitative regimes in Section III We then use the fluid limits to 
demonstrate the potential instability of aggressive activity functions in Sections IV and [V] Simulation experiments 
are conducted in Section VI to support the analytical results. In Section VII we make some concluding remarks 
and identify topics for further research. Appendices at the end of the paper contain proofs of our results. 
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II. Model description 
Network, interference graph, and traffic model 

We consider a network of several nodes sharing a wireless medium according to a random-access mechanism. The 
network is represented by an undirected graph G = {V, E) where the set of vertices V = {1, . . . , N} correspond to 
the various nodes and the set of edges C y x 1/ indicate which pairs of nodes interfere. Nodes that are neighbors 
in the interference graph are prevented from simultaneous activity, and thus the independent sets correspond to 
the feasible joint activity states of the network. A node is said to be blocked whenever the node itself or any of 
its neighbors is active, and unblocked otherwise. Define S C {0, 1}^ as the set of incidence vectors of all the 
independent sets of the interference graph, and denote by C = conv(S') the capacity region, with conv(-) indicating 
the convex hull operator. 

Packets arrive at node i as a Poisson process of rate Aj. The packet transmission times at node i are independent 
and exponentially distributed with mean l/^j. Denote by pi = the traffic intensity of node i. 

Let U{t) G S represent the joint activity state of the network at time t, with Ui{t) indicating whether node i is 
active at time t or not. Denote by Xi{t) the queue length at node i at time t, i.e., the number of packets waiting 
for transmission or in the process of being transmitted. 

Queue-based random-access mechanism 

As mentioned above, the various nodes share the medium in accordance with a random-access mechanism. When 
a node ends an activity period (consisting of possibly several back-to-back packet transmissions), it starts a back-off 
period. The back-off times of node i are independent and exponentially distributed with mean l/vi. The back-off 
period of a node is suspended whenever it becomes blocked by activity of any of its neighbors, and only resumed 
once the node becomes unblocked again. Thus the back-off period of a node can only end when none of its 
neighbors are active. Now suppose a back-off period of node i ends at time t. Then the node starts a transmission 
with probability (j)i{Xi{t)), with 0j(O) = 0, and begins a next back-off period otherwise. When a transmission of 
node i ends at time t, it releases the medium and begins a back-off period with probability ipi{Xi{t^)), or starts the 
next transmission otherwise, with = 1. Equivalently, node i may be thought of as activating at an exponential 
rate fi{Xi{t)), with /j(-) = whenever it is unblocked at time t, and de-activating at rate gi{Xi{t)), with 

gi{-) = iJ,i'ipi{-), whenever it is active at time t. For conciseness, the functions fi{-) and gi{-) will be referred to as 
activation and de-activation functions, respectively. 

There are two special cases worth mentioning that (loosely) correspond to random-access schemes considered in 
the literature before. First of all, in case 4'i{Xi) = 1 and ipi{Xi) = for all Xi> 1, node i starts a transmission 
each time a back-off period ends, and does not release the medium, i.e., continues transmitting until its entire 
queue has been cleared. This corresponds to the random-capture scheme considered in ifTll . In case p^i = 1, Vi = 1, 
4>i{Xi) = 1 — il)i{Xi), and ipi{Xi) = 1/(1 + rj(Xi)), node i may be thought of as becoming (or continuing 
to be) active with probability rj(Xj(i))/(l + ri{Xi{t))) each time a unit-rate Poisson clock ticks. This roughly 
corresponds to the scheme considered in |[T5l . |[T8l . |[29l . ||34l . |[35l based on Glauber dynamics with a 'weight' 
function Wi{Xi) = log(rj(Xj)), except that the latter scheme operates with a random round-robin clock, and uses 

Wi{Xi) = maxlwiiXi), ^WiiXraax)}, with Xmax = maXj=i^,„^N Xj. 

Network dynamics 

Under the above-described queue -based schemes, the process {{U{t), X{t))}t>o evolves as a continuous-time 
Markov process with state space S x Nq . Transitions (due to arrivals) from a state {U,X) to {U,X-\-ei) occur at 
rate Aj, transitions (due to activations) from a state {U, X) with Xi > 1, Ui = 0, and Uj = for all neighbors of 
node i, to {U + ei,X) occur at rate Uifi{Xi), transitions (due to transmission completions followed back-to-back 
by a subsequent transmission) from a state {U, X) with Ui = 1 (and thus Xi > 1) to ([/, X — a) occur at rate 
— gi{Xi)), transitions (due to transmission completions followed by a back-off period) from a state {U,X) 
with Ui = 1 (and thus Xi > 1) to {U — ei,X — a) occur at rate fiigi{Xi). 

We are interested to determine under what conditions the system is stable, i.e., the process {{U{t), X(t))}t>o is 
positive-recurrent. It is easily seen that (pi, . . . , p^r) < fi G C is a necessary condition for that to be the case. In Iil5l . 
it is shown that this condition is in fact also sufficient for weight functions of the form Wi{Xi) = log(l+Xj)/yj(Xj), 
where yi{Xi) is allowed to increase to infinity at an arbitrarily slow rate. For practical purposes, this means that 
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the function rj(Xj) is essentially allowed to be linear, except that it must eventually grow to infinity slower than 
any positive power of Xj. Results in (4] suggest that more aggressive choices of the functions /j(-) and gi{-), 
which translate into functions rj(-) that grow faster to infinity, can improve the delay performance. In view of these 
results, we will be particularly interested in such functions rj(-), where the stability results of [15] do not apply. 
In order to examine under what conditions the system will remain stable then, we will examine fluid limits for the 
process {{U{t), X{t))}t>o as introduced in the next section. 

III. Qualitative discussion of fluid limits 

Fluid limits may be interpreted as first-order approximations of the original stochastic process, and provide 
valuable qualitative insight and a powerful approach for establishing (in)stability properties ||5l, lH, Q, ||27]| . In 
this section we discuss fluid limits for the process {{U{t), X{t))}t>o from a broad perspective, with the aim to 
informally exhibit their qualitative features in various regimes, and we deliberately eschew rigorous claims or proofs. 

A. Fluid-scaled process 

In order to obtain fluid limits, the original stochastic process is scaled in both space and time. More specifically, 
we consider a sequence of processes {{U^^\t) , X^^^ {t))}t>o indexed by a sequence of positive integers R, each 
governed by similar statistical laws as the original process, where the initial states satisfy Xli^i -^i^^ (0) — ^ ^^'^ 
x\^\{))/R ^ Qi as oo. The process {{U'-^\Rt), j^X^^\Rt))}t>o is referred to as the fluid-scaled version 
of the process {(C/(^)(t),X(^)(t)}t>o. Note that the activity process is scaled in time as well but not in space. 
For compactness, denote Q^{t) = j^X^^^Rt). Any (possibly random) weak limit {Q{t)}t>o of the sequence 
{Q^ {t)}t>o^ as i? — )• oo, is called a fluid limit. 

It is worth mentioning that the above notion of fluid limit based on the continuous-time Markov process is only 
introduced for the convenience of the qualitative discussion below. For all the proofs of fluid limit properties and 
instability results we will rely on a rescaled linear interpolation of the uniformized jump chain (as will be defined in 
Appendix A.I), with a time-integral version of the [/(•) component. This construction yields convenient properties 
of the fluid limit paths and allows us to extend the framework of Meyn 1.27,1 for establishing instability results 
for discrete-time Markov chains. (The original continuous-time Markov process has in fact the same fluid limit 
properties, but this is not directly relevant in any of the proofs.) 

The process {{U^^\Rt), j^X^^-^ {Rt))}t>o comprises two interacting components. On the one hand, the evolution 
of the (scaled) queue length process ^X^^^{Rt) depends on the activity process U^^^{Rt). On the other hand, the 
evolution of the activity process U^^{Rt) depends on the queue length process X^^\Rt) through the activation 
and de-activation functions /j(-) and gi{-). In many cases, a separation of time scales arises as R ^ oo, where 
the transitions in U^^\Rt) occur on a much faster time scale than the variations in Q^{t) = j^X^^\t). Loosely 
phrased, the evolution of Q^{t) is then governed by the time-average characteristics of U^^\-) in a scenario where 
Q^{t) is fixed at its instantaneous value. 

In other cases, however, the transitions in U^^\Rt) may in fact occur on a much slower time scale than the 
variations in Q^{t), or there may not be a separation of time scales at all. As a result, qualitatively different types 
of fluid limits can arise, as observed in [4], depending on the mixing properties of the activity process. These 
mixing properties, in turn, depend on the functional shape of the activation and de-activation functions /i(-) and 
gi{-), in conjunction with the structure of the interference graph G. 

B. Fast mixing: smooth deterministic fluid limits 

We first consider the case of fast mixing. In this case, the transitions in U^^\Rt) occur on a much faster time 
scale than the variations in Q^{t), and completely average out on the fluid scale as i? — )• oo. Informally speaking, 
this entails that the mixing time of the activity process in a scenario with fixed activation rates fi{Rqi) and de- 
activation rates gi{Rqi) grows slower than ii as i? oo. In order to obtain a rough bound for the mixing time, 
assume that /j(-) = /(•), gi{-) = g{-), and denote h{x) = f{x)/g{x). Further suppose that h{R) — )• oo as i? — )• oo, 
and h{aR)/h{R) — h{a) as — )• oo, with h{a) > for any a > 0. The latter assumptions are satisfied, for 
example, when h{x) = x"i , 7 > 0, with h{a) = , or when h{x) = log(x) with h{a) = 1. Without proof, we 
claim that the mixing time then grows at most at rate f{R)"^^^g{R)^"^' as R ^ 00, with m* the cardinality of 
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a maximum- size independent set. Thus, fast mixing behavior is guaranteed when /(•) does not grow too fast, g{-) 
does not decay too fast, or m* is sufficiently small, e.g., 

(i) g{x) = g and m* = 1; 

(ii) f ix) = g(^x) = g, and m* > 2; 

(iii) f ix) = f and g{x) > x-V"^*+'5; 

(iv) f{x) = f, g{x) = l/log{l + x); 

(v) f{x) = log(l + x) and g{x) = g. 

As mentioned above, the fluid limit then follows an entirely deterministic trajectory, which is described by a 
differential equation of the form 

— = Xi- tiiUi{Q{t)), 

as long as Q{t) > (component-wise), with the function nj(-) representing the fraction of time that node i is 
active. We may write 

Mq) = ^■5i7r(s;g), 

with 7r(s; q) denoting the fraction of time that the activity process resides in state s G S" in a scenario with fixed 
activation rates fj{Rqj) and de-activation rates gj{Rqj) as ii — )• oo. Let S* = {s € S : J2iLi — ^*} correspond 
to the collection of all maximum-size independent sets. Under the above-mentioned assumptions, 

N 

n HRq^r^ 

7r(s; q) = liniij^^oo 



i=l 



for s G 5*, while 7r(s; q) = for s ^ S*. In particular, if h{x) = x'^, 7 > 0, then 

TV 

-1 i-iy III "1/ > 

7r(s;g) 



R"^''^ _ eMlZ'llSilog{q^)) 



1=1 



for s G S*. Also, if h{x) = log(l + x), then tt{s; q) = l/\S*\ for s G 5*. 

When some of the components of q are zero, i.e., some of the queue lengths are zero at the fluid scale, it is 
considerably harder to characterize Ui{q), since the competition for medium access from the queues that are zero 
at the fluid scale still has an impact. It may be shown though that 



N N 
■t=l i=l 



■ P^Hqi > 0} ^ (1 - e) > 0} 



for some e > 0, assuming that [pi, . . . , pj\^) < a £ C. The latter inequality also holds when g > 0, noting that then 
J2iLi = while Yld=i Pi < {'^ - for some e > 0. 



We conclude that almost everywhere 

E^^ s E(p.-''.«5(')))i{ftw>o} 



N 

^ -'T.p^\Q,{t)>oy 

i=l 



as long as Q{t) / 0. This means that Q{t) =0 for all t > T for some finite T < 00, which implies that the 
original Markov process is positive-recurrent lH, Q. This agrees with the stability results in lITSl . lITSl . ||29ll . ||35]| . 

(21 for the case f{Xi) = l-g{X,) and g{Xi) = l/{l + eMw{Xi))), w{Xi) = max{ii;(Xi), 2^^(^max)} (with 



Fig. 1. The diamond network: A complete partite graph with K = 3 components, each containing 2 nodes. 



the minor differences noted in the previous section), and suggests that these results in fact hold without the need 
to know the maximum queue size Xmax- 

Of course, in order to convert the above arguments into an actual stability proof, the informal characterization 
of the fluid limit needs to be rigorously justified. This is a major challenge, and not the real goal of the present 
paper, since we aim to demonstrate the opposite, namely that more aggressive activity or de-activation functions 
can cause instability. Strong evidence of the technical complications in establishing the fluid limits is provided by 
recent work of Robert & Veber lf301 . Their work focuses on the simpler case of a single work-conserving resource 
(which corresponds to a full interference graph in the present setting) without any back-off mechanism, where the 
service rates of the various nodes are determined by a logarithmic function of their queue lengths. 

C. Sluggish mixing: erratic random fluid limits 

With the above aim in mind, we now turn to the case of sluggish mixing. In this case, the transitions in U^^^ (Rt) 
occur on a much slower time scale than the variations in Q^{t), and vanish on the fluid scale as i? — oo, except 
at time points where some of the queues hit zero. The detailed behavior of the fluid limit in this case depends 
delicately on the specific structure of the interference graph G and the shape of the functions fi{-) and gi{-). This 
prevents a characterization in any degree of generality, and hence we focus attention on some particular scenarios. 

In order to show that sluggish mixing behavior itself need not imply instability, we first examine a complete 
iT-partite graph as considered in [12J, where the nodes can be partitioned into K > 2 components. All nodes 
are connected except those belonging to the same component. Figure [T] depicts an example of a complete partite 
graph with K = 3 components, each containing 2 nodes. We will refer to this network as the diamond network, 
since the edges correspond to those of an eight-faced diamond structure, with the node pairs constituting the three 
components positioned at the opposite ends of three orthogonal axes. 

Denote by C {!,..., N} the subset of nodes belonging the A;-th component. Once one of the nodes in 
component Mk is active, other nodes within can become active as well, but none of the nodes in the other 
components Mi, I ^ k, can be active. The necessary stability condition then takes the form p = J2k=i Pk < 1> 
with Pk = maxjgAffc Pi denoting the maximum traffic intensity of any of the nodes in the A;-th component. 

Now consider the case that each node operates with an activation function f{x) with lima;_j.oo f{x)>0 and a 
de-activation function g{x) = o{x~'^), with 7 > 1, which subsumes the random-capture scheme with g{x) = for 
all x > 1 in U2]- Since the de-activation rate decays so sharply, the probability of a node releasing the medium 
once it has started transmitting with an initial queue length of order R, is vanishingly small, until the queue length 
falls below order R or the total number of transmissions exceeds order R (but the latter implies the former). Hence, 
in the fluid limit, a node must completely empty almost surely before it releases the medium. Because of the 
interference constraints, it further follows that once the activity process enters one of the components, it remains 
there until all the queues in that component have entirely drained (on the fluid scale), and then randomly switches 
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Fig. 2. A fluid limit sample path for the diamond network of Figure [T] 



to one of the other components. For conciseness, the fluid limit process is said to be in an -period during time 
intervals when at least one of the nodes in component Af^ is served at full rate (on the fluid scale). 

Based on the above informal observations, we now proceed with a more detailed description of the dynamics of 
the fluid limit process. We do not aim to provide a proof of the stated properties, since the main goal of the present 
paper is to demonstrate the potential for instability rather than establish stability. However, the proof arguments 
that we will develop for a similar but more complicated interference graph in the remainder of the paper, could 
easily be applied to provide a rigorous justification of the fluid limit and establish the claimed stability results. 

Assume that the system enters an -period at time t, then 

(a) It spends a time period T}^{t) = maxjgj\4 in M^. 

(b) During this period, the queues of the nodes in drain at a linear rate (or remain zero) 

Qi{t + u) = max{(5j(t) + (Aj - 0}, Vi e M^, 
while the queues of the other nodes fill at a Unear rate 

Qi{t + u) = Qi{t) + Xiu, Vi Mfe, 

for all u G [0,Tk{t)]. 

(c) At time t + Tk{t), the system switches to an M^-period, I k, with probability 



Vki{t + Tk{t)) 



lim 



T.v^k,i EieM, fiRQiit + Tkm' 



Thus the fluid limit follows a piece-wise linear sample path, with switches between different periods governed 
by the transition probabilities specified above. Figure |2] depicts an example of the fluid limit sample path for the 
network of Figure [T]with f{x) = 1, X > 1. 

Now define the Lyapunov function L{t) := X]^iOfc(i)' with Qk{t) = maxi^Mk Qii't)/ fJ-i- Then, ^L{t) < 
1 = p — 1 < almost everywhere when p < 1, as long as L{t) > 0. Therefore, L{t) = 0, and hence 



Q{t) = 0, for aU t > T, with T 
not smooth at all. 



i-p 



< 00, implying stability JH, Q, even though the fluid limit behavior is 



IV. Fluid limits for broken-diamond network 

In the previous section we discussed qualitative features of fluid limits in various scenarios, and in particular for so- 
called complete partite graphs. We now proceed to consider a 'nearly' complete partite graph, and will demonstrate 
that if some of the edges between two components Mk and Mi are removed (thus reducing interference), the network 
might become unstable for 'aggressive' activation and/or deactivation functions! Specifically, we will consider the 
diamond network of Figure [TJ and remove the edge between nodes 4 and 5 to obtain a broken-diamond network 
with an additional component/maximal schedule M4, as depicted in Figure |3] 

The intuitive explanation for the potential instability may be described as follows. Denote po = iiiax{/Ji, /32}, 
and assume > and pe > p^. It is easily seen that the fraction of time that at least one of the nodes 1, 2, 
3 and 6 is served, must be no less than p = po + Ps + Pe in order for these nodes to be stable. During some of 
these periods nodes 4 or 5 may also be served, but not simultaneously, i.e., schedule M4 cannot be used. In other 



Fig. 3. The broken-diamond network, obtained by removing 1 edge from the diamond network of Figure [T| yielding an additional schedule 
M4. 



words, the system cannot be stable if schedule M4 is used for a fraction of the time larger than 1 — p. As it turns 
out, however, when the de-activation function is sufficiently aggressive, e.g., g{x) = o(x^^), with 7 > 1, schedule 
M4 is in fact persistently used for a fraction of the time that does not tend to as /) approaches 1, which forces 
the system to be unstable. 

Although the above arguments indicate that invoking schedule M4 is a recipe for trouble, the reason may not be 
directly evident from the system dynamics, since no obvious inefficiency occurs as long as the queues of nodes 4 
and 5 are non-empty. However, the fact that the Lyapunov function L{t) = X]fc=i ™axj(=jv/^ Qi{t) may increase while 
serving nodes 4 and 5, when Qz{t) > Q^it) and Q6{t) > Q^{t), is already highly suggestive. (Such an increase 
is depicted in Figure |4] during the Af4 period of the switching sequence Mi — )• M2 — )• Mi — )• M4 — )• M3 — )• Mi.) 
Indeed, serving nodes 4 and 5 may make their queues smaller than those of nodes 3 and 6, leaving these queues 
to be served by themselves at a later stage, at which point inefficiency inevitably occurs. 

In the sequel, the fluid limit process is said to be in a natural state when Q-i{t) > Q4,{t) and Q&{t) > Q^{t), with 
equality only when both sides are zero. We will assume A3 > A4 and Ag > A5, and will show that the process must 
always reside in a natural state after some finite amount of time. As described above, instability is bound to occur 
when schedule M4 is used repeatedly for substantial periods of time while the fluid limit process is in a natural 
state. Since the process is always in a natural state after some finite amount of time, it is intuitively plausible that 
such events occur repeatedly with positive probability, but a rigorous proof that this leads to instability is far from 
simple. Such a proof requires detailed analysis of the underlying stochastic process (in our case via fluid limits), 
and its conclusion crucially depends on the de-activation function. Indeed, the stability results in ||T5l . |[T8l . ||29]| . 
Il34l . Il35l indirectly indicate that the broken-diamond network is not rendered unstable for sufficiently cautious 
de-activation functions. 

Just like for the complete partite graphs, the fluid limit process is said to be in an Mi-period when node 1 or 
node 2 (or both) is served at full rate. The process is in an M2- or M3 -period when node 3 or 6 is served at full 
rate, respectively. The process is in an M4-period when nodes 4 and 5 are both served at full rate simultaneously. 

In Subsection IV-A we will provide a detailed description of the dynamics of the fluid limit process once it has 
reached a natural state and entered an Mi-, M2-, M3 or M4-period. The justification for the description follows 
from a collection of lemmas and propositions which are stated and proved in Appendices A-D, with a high-level 
outline provided in Subsection IV-B In Section [V] we will exploit the properties of the fluid limit process in order 
to prove that the harmful behavior described above indeed occurs for sufficiently aggressive de-activation functions, 
implying instability of the fluid limit process as well as the original stochastic process. 



A. Description of the fluid limit process 

We now provide a detailed description of the dynamics of the fluid limit process once it has reached a natural 
state and entered an Mi-, M2-, M3 or M4-period. For sufficiently high load, i.e., p sufficiently close to 1, a natural 
state and such a period occur in uniformly bounded time almost surely for any initial state. As will be seen, 
for de-activation functions gi{x) = o{x~'^), with 7 > 1, the fluid limit process then follows similar piece-wise 



9 




linear trajectories, with random switches, as described in the previous section for complete partite graphs and 
further illustrated in Figure |4] For notational convenience, we henceforth assume ^Uj = 1, so that pj = Aj, for all 
i = 1, . . . , N, and additionally assume activation functions fi{x) = 1, x > 1, for alH = 1, . . . , N. 

1) Mi-period: Assume the system enters an Afi -period at time t, then 

(a) It spends a time period Ti{t) = max |^^, in Mi. 

(b) During this period, the queues of nodes 1 and 2 drain at a linear rate (or remain zero) 

Qi{t + u) = max{Qi{t) - (1 - Pi)u, 0}, for i = l,2, 
while the queues of nodes 3, 4, 5, 6 fill at a linear rate 

Qi{t + u) = Qi{t) + piu, for i = 3, 4, 5, 6, 

for all u G [0,ri(t)]. In particular, Qi{t + Ti{t)) = Q2{t + Ti{t)) = 0. 

(c) At time t + Ti(t), the system switches to an M2-, M3- or M4-period with transition probabilities pi2 = |, 
Pi3 = |> and pu = \, respectively. 

2) M2-period: Assume that the system enters an M2-period at time t, then 

(a) The system spends a time period T2{t) = in M2. 

(b) During this period, the queues of nodes 3 and 4 drain (or remain zero) 

Qi{t + n) = max{Qj(t) - (1 - Pi)u, 0}, for i = 3, 4, 
while the queues of nodes 1, 2, 5, 6 fill at a linear rate 

Qi{t + u) = Qi{t) + piU, for i = 1, 2, 5, 6, 

for all u G [0,T2{t)]. In particular, Q3{t + T2{t)) = 0. 

(c) At time t + T2{t), the system switches to an Mi- or Ms-period. Note that > by the assumption 
that A3 > A4 and that the process has reached a natural state, so that Q-i{t) > Q^it) (since Qs{t) = Qi{t) = 
cannot occur at the start of an M2-period). Thus node 4 has emptied before time t + T2{t), and remained 
empty (on the fluid scale) since then, precluding a switch to an Af4-period except for a negligible duration 
on the fluid scale), only allowing the system to switch to either an Mi- or Afs-period. The corresponding 
transition probabilities can be formally expressed in terms of certain stationary distributions, but are difficult 
to obtain in explicit form. Note that in order for any of the nodes 1, 2, 5 or 6 to activate, node 3 must 
be inactive. In order for nodes 1, 2 or 6 to activate, node 4 must be inactive as well, but the latter is not 
necessary in order for node 5 to activate. Since node 4 may be active even when it is empty on the fluid 
scale, it follows that node 5 enjoys an advantage in competing for access to the medium over nodes 1, 2 and 
6. While it may be argued that node 4 is active with probability p4 by the time node 3 becomes inactive for 
the first time, the resulting probabilities for the various nodes to gain access to the medium first do not seem 
to allow a simple expression. 

Remark 1: If the process had not yet reached a natural state, the case 

< could also arise. In case 

that inequality is strict, i.e., < t~^^ the queue of node 4 is still non-empty by time t + T2(t), simply 
forcing a switch to an M4-period with probability 1. 
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In case of equality, i.e., = jzr^, however, the situation would be much more complicated, which serves 
as the illustration for the significance of the notion of a natural state. In order to describe these difficulties, 
note that the queues of nodes 3 and 4 both empty at time t + T2{t), barring a switch to an M4 -period, and 
permitting only a switch to either an Mi- or M3 -period. Just hke before, node 5 is the only one able to 
activate during periods where node 3 is inactive while node 4 is active, and hence enjoys an advantage in 
competing for access to the medium. In fact, node 5 will gain access to the medium first almost surely if 
node 3 is the first one to become inactive (in the pre-limit). The probability of that event, and hence the 
transition probabilities to an Mi- or Ms-period, depends on queue length differences between nodes 3 and 4 
at time t that can be affected by the history of the process and are not visible on the fluid scale. 

3) M^-period: The dynamics for an Ma-period are entirely symmetric to those for an M2-period, but will be 
replicated below for completeness. 

Assume that the system enters an Ma-period at time t, then 

(a) The system spends a time period ^^(t) = jz!^ in M3. 

(b) During this period, the queues of nodes 5 and 6 drain (or remain zero) 

Qi{t + u) = max{Qi{t) - (1 - Pi)u, 0}, for i = 5, 6, 
while the queues of nodes 1, 2, 3, 4 fill at a Unear rate 

Qi{t + u) = Qi{t) + piu, for i = l,2, 3, 4, 

for all u e [0,T3{t)]. In particular, Qe{t + Ts{t)) = 0. 

(c) At time t + T^it), the system switches to an Mi- or M2-period. Note that < by the assumption 
that A5 > Ae and that the process has reached a natural state, so that Q^{t) < Q6{t) (since Q^it) = Qeit) = 
cannot occur at the start of an M3 -period). 

Thus node 5 has emptied before time t + Ts{t), and remained empty (on the fluid scale) since then, precluding 
a switch to an M4-period (except for a negligible period on the fluid scale), only allowing the system to switch 
to either an Mi- or M2-period. The corresponding transition probabilities are difficult to obtain in explicit 

form for similar reasons as mentioned in case 2(c). 

Remark 2: If the process had not yet reached a natural state, the case 

QM > could also arise. In case 

that inequaUty is strict, i.e., jzr^ < the queue of node 5 is still non-empty by time t + T3{t), forcing 

a switch to an M4-period with probability 1. 

In case of equality, i.e., = queues of nodes 5 and 6 both empty at time T^lt), barring a 

switch to an M4-period, and permitting only a switch to either an Mi- or M2-period. For similar reasons 
as mentioned in case 2(c), the corresponding transition probabiUties depend on queue length differences that 
are affected by the history of the process and are not visible on the fluid scale. 

4) Mi-period: Assume that the system enters an M4-period at time t, then 

(a) It spends a time period Ti{t) = min j^iM^ in ^4- 

(b) During this period, the queues of nodes 4 and 5 drain at a linear rate 

Qi{t + u) = Qi{t) - (1 - Pi)u, for z = 4, 5, 
while the queues of nodes 1, 2, 3, 6 fill at a Unear rate 

Qi{t + u) = Qi{t) + piU, for 1 = 1,2, 3, 6, 

u e [0, T4{t)]. In particular, min{Q4(t + T4{t)),Q5{t + T4{t))} = 0. 

(c) At time t + T4{t), the system switches to either an M2- or Ma-period. In order to determine which of these 
events can occur, we need to distinguish between three cases, depending on whether jzr^ is (i) larger than, 
(ii) equal to, or (iii) smaller than j^^- 

In case (i), i.e., > y~^^ we have Q^U + TAt)) > 0, i.e., the queue of node 4 is still non-empty by 

J- i- p^ 

time t + Tiit), causing a switch to an M2 -period with probability 1. 

In case (ii), i.e., = we have Q4{t + T4{t)) = Q-,{t + T4{t)) = 0, i.e., the queues of nodes 4 and 5 
both empty at time t + T4{t). Even though both queues empty at the same time on the fluid scale, there will 
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with overwhelming probabiUty be a long period in the pre-limit where one of the nodes has become inactive 
for the first time while the other one has yet to do so. Since both nodes 4 and 5 must be inactive in order 
for nodes 1 and 2 to activate, these nodes have no chance to activate during that period, but either node 3 
or node 6 does, depending on whether node 5 or node 4 is the first one to become inactive. As a result, the 
system cannot switch to an Mi -period, but only to an M2- or M3 -period. In fact, a switch to M2 will occur 
almost surely if node 5 is the first one to become inactive, while a switch to M3 will occur almost surely if 
node 4 is the first one to become inactive. The probabilities of these two scenarios, and hence the transition 
probabilities to M2 and M3, depend on queue length differences between nodes 4 and 5 at time t that are 
affected by the history of the process and are not visible on the fluid scale. 

In case (iii), i.e., < have Q^{t + Ti{t)) > 0, i.e., the queue of node 5 is still non-empty by 

time t + T4(t), forcing a switch to an Ma-period with probability 1. 
Remark 3: As noted in the above description of the fluid limit process, in cases 2(c), 3(c), and 4(c)(ii) the 
transition probabilities from an M2-period to an Mi- or Ms-period, from an Ma-period to an Mi- or M2-period, 
and from an M4- to an M2- or Ma-period, depend on queue length differences that are affected by the history 
of the process and are not visible on the fluid scale. Depending on whether or not the initial state and parameter 
values allow for these cases to arise, it may thus be impossible to provide a probabilistic description the evolution 
of the resulting fluid limit process, even it terms of its entire own history. 

B. Overview of fluid limit proofs 

In the previous subsection we provided a description of the dynamics of the fluid limit process once it has reached 
a natural state and entered an Mi, M2-, M3 or M4-period. As was further stated, for p sufficiently close to 1, a 
natural state and such a period occur in uniformly bounded time almost surely for any initial state. The justification 
for all these properties follows from a series of lemmas and propositions stated and proved in Appendices A-D. 
In this subsection we present a high-level outline of the fluid limit statements and proofs. 

First of all, recall that the description of the fluid limit process referred to the continuous-time Markov process 
representing the system dynamics as introduced in Section |ll] For all the proofs of fluid limit properties and 
instability results however we consider a rescaled linear interpolation of the uniformized jump chain (as defined 
in Appendix A.I). This construction yields convenient properties of the fluid limit paths and allows us to extend 
the framework of Meyn ETl for establishing instability results for discrete-time Markov chains. (The original 
continuous-time Maikov process has in fact the same fluid limit properties, but this is not directly relevant in any 
of the proofs.) 

The proofs of the fluid limit properties consist of four main parts. Part A identifies several basic properties of the 
fluid limit paths, and in particular establishes that the queue length trajectory of each of the individual nodes exhibits 
'sawtooth' behavior. This fundamental property in fact holds in arbitrary interference graphs, and only requires an 
exponent 7 > 1 in the backoff probability. Part B of the proof shows a certain dominance property, saying that 
if all the interferers of a particular node also interfere with some other node that is currently being served at full 
rate, then the former node must be empty or served at full rate (on the fluid scale) as well. Under the assumption 
A3 > A4, A5 < Ag, the dominance property implies that after a finite amount of time the fluid limit process for 
the broken-diamond network must always reside in a natural state as defined in the previous subsection. Part C of 
the proof centers on the Mi-, M2-, M3- and M4 -periods, and establishes that at the end of any such period, the 
process immediately switches to one of the other types of periods with the probabilities indicated in the previous 
subsection. In particular, it is deduced that an M4-period cannot be entered from an M2- or Ms-period, and must 
always be preceded by an Mi -period once the process has reached a natural state. The combination of the sawtooth 
queue length trajectories and the switching probabilities provides a probabilistic description of the dynamics of the 
fluid limit once the process has reached a natural state and entered an Mi-, M2-, M3- or M4-period. Part B already 
established that the process must always reside in a natural state after a finite amount of time, but it remains to be 
shown that the process will inevitably enter an Mi-, M2-, M3- or M4- period, which constitutes the final Part D 
of the proof. The core argument is that interfering empty and nonempty queues can not coexist, since the empty 
nodes will frequently enter back-off periods, offering the nonempty nodes abundant opportunities to gain access, 
drain their queues, and cause the empty nodes to build queues in turn. 

Part A of the proof starts with the simple observation that, by the " skip-free" property of the original pre-limit 
process, the sample paths of the interpolated version of the uniformized jump chain are Lipschitz continuous, and 
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hence so are the sample paths of the fluid-scaled process. The fluid limit paths inherit the Lipschitz continuity, and 
are thus differentiable almost everywhere with probability one. 

Then fluid limit paths are determined by a countable set of 'entrance' times and 'exit' times of (0, oo) with 
probability one. The proof then proceeds to show that if a nonempty node (on the fluid scale) receives any amount 
of service during some time interval, then it must in fact be served at the full rate until it has completely emptied 
(on the fluid scale), assuming 7 > 1. This implies that when node i is nonempty (on the fluid scale), its queue 
must either increase at rate Aj or decrease at rate 1 — Aj until it has entirely drained. In other words, the queue 
length trajectory of each of the individual nodes exhibits sawtooth behavior (Theorem [5]l. 

Part B of the proof pertains to the joint behavior of the fluid limit trajectories of the various queue lengths. 
First of all, the natural property is proved that whenever a particular node is served, none of its interferers can 
receive any service (Lemma |3]l. Second, it is established that whenever a particular node is served, any node whose 
interferers are a subset of those of the node served, must either be empty or be served at full rate as well (on the 
fluid scale) (Corollary [3]). For example, in the broken-diamond network, whenever node 3 is served, node 4 must 
either be empty or be served at full rate as well, and similarly for nodes 5 and 6. These two properties combined 
yield a dominance property, saying that if all the interferers of a particular node also interfere with some other node 
that is currently being served at full rate, then the former node must be empty or served at full rate (on the fluid 
scale) as well. In the case of the broken-diamond network, under the assumption A3 > A4, the queue of node 3 will 
therefore never be smaller than that of node 4 after some finite amount of time, and similarly for nodes 4 and 5. 
Thus the fluid limit process will always reside in a natural state after some finite amount of time. 

Part C of the proof focuses on the Mi-, M2-, M3- and M4-periods as described above. Because of the sawtooth 
behavior, an Mi -period can only end when both nodes 1 and 2 are empty (on the fluid scale). Likewise, an M2- 
or Ma-period can only end when node 3 or node 6 is empty, respectively. An M4-period can only end when 
node 4 or node 5 (or both) is empty. It is then proven that at the end of an Mi -period, the fluid limit process 
immediately switches to an M2-, M3- or M4-period with the probabilities specified in the previous subsection 
(Theorem [7]). When the process resides in a natural state, an M2-period is always instantaneously followed by an 
Ml- or Ms-period, while an Ma-period is always instantaneously followed by an Mi- or Af2-period. In particular, 
it is concluded that an M4-period cannot be entered from an M2- or Ma-period, and must always be preceded by 
an Afi-period once the process has reached a natural state. After an M4-period, the process always immediately 
switches to an M2- or Ma-period. 

There is no reason a priori however that the process is guaranteed to actually ever enter an Mi-, M2-, M^- or 
M4- period. In fact, the process may very well spend time in different kinds of states, but the final Part D of the 
proof establishes that these kinds of states are transient, and cannot occur once a natural state has been reached, 
which is forced to happen in a finite amount of time for particular arrival rates as was already shown in Part B. 
Note that an Mi-, M2-, M3- or M4- period occurs as soon as node 1, node 2, node 3, node 6 or nodes 4 and 5 
simultaneously are served at full rate. In other words, the only ways for the process to avoid an Mi-, M2-, M3- or 
M4-period, are: (i) for node 4 to be served at full rate, but not nodes 3 and 5; (ii) for node 5 to be served at full 
rate, but not nodes 4 and 6; (iii) for none of the nodes to be served at full rate. Scenario (i) requires node 3 to be 
empty (on the fluid scale) and node 4 to be nonempty, which can not occur in a natural state. Likewise, scenario (ii) 
cannot arise in a natural state either. Scenario (iii) requires that every empty node i is served at rate pi (on the fluid 
scale), while all nonempty nodes are served at rate 0. Such a scenario is not particularly plausible, but a rigorous 
proof turns out to be quite involved. The insights rely strongly on the specific properties of the broken-diamond 
network, and an extension to arbitrary graphs does not seem straightforward. The core argument is that interfering 
empty and nonempty queues can not coexist, since the empty nodes will frequently enter back-off periods, offering 
the nonempty nodes abundant opportunities to gain access, drain their queues, and cause the empty nodes to build 
queues in turn. 

V. Instability results for broken-diamond network 

In the previous section we provided a detailed description of the dynamics of the fluid limit process once it has 
reached a natural state and entered an Mi-, M2-, M3 or M4 -period. In this section we exploit the properties of 
the fluid limit process in order to prove that it is unstable for p sufficiently close to 1, and then show how the 
instability of the original stochastic process can be deduced from the instability of the fluid limit process. 
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A. Instability of the fluid limit process 

In order to prove instability of the fluid limit process, we first revisit the intuitive explanation discussed earlier, 
see Figure |4] for an illustration. Denote po = niax{pi, /92}, and recall that p3 > p4 and ps < by assumption. 
Since nodes 1, 2, 3 and 6 are only served during Mi-, M2- and Ma-periods, and not during M4 -periods, it is 
easily seen that the fraction of time that the system spends in Mi-, M2- and Ms-periods must be no less than 
P = Po + /03 + /O6 in order for these nodes to be stable. Thus, the system cannot be stable if it spends a fraction of 
the time larger than 1 — p in M4-periods. As it turns out, however, when the de-activation function is sufficiently 
aggressive, e.g., g{x) = o{x~'^), with 7 > 1, M4-periods in fact persistently occur for a fraction of time that does 
not tend to as /? approaches 1, which forces the system to be unstable. 

Figure [4] shows a fluid-limit sample path corresponding to the switching sequence Mi — )• M2 — )• Mi — )• M4 — )• 
M3 — Ml. The aggregate queue size starts building up in the Ms-period that follows the M4 -period. 

In order to prove instability of the fluid limit process, we adopt the Lyapunov function L{t) = X]fc=i maxjgTv/fc Qiit), 
and will show that the load L{t) grows without bound almost surely. Note that the load L{t) increases during M4- 
periods while the process is in a natural state. 

In preparation for the instability proof, we first state two auxiliary lemmas. It will be convenient to view the 
evolution of the fluid limit process, and in particular the Lyapunov function L{t), over the course of cycles. The 
i-th cycle is the period from the start of the {i — l)-th Mi -period to the start of the i-th Mi -period once the fluid 
limit process has reached a natural state. Denote by tj the start time of the i-th cycle, i = 1,2, ... . Each ti is 
finite almost surely for p sufficiently close to 1, and in particular an infinite number of cycles must occur almost 
surely. In order to see that, recall that the fluid limit process will reach a natural state and enter an Mi, M2, M3- 



or M4-period in finite time almost surely for any initial state as stated in Subsection IV-A The description of the 
dynamics of the fluid limit process provided in that subsection then implies that Mi -periods and hence cycles must 
occur infinitely often (and if only finitely many Afi -periods occurred, then at least one of the nodes would in fact 
never be served again after some finite time, implying that the fluid limit process is unstable regardless). 

The next lemma shows that the duration of a cycle and the possible increase in the load over the course of a 
cycle are linearly bounded in the load at the start of the cycle. 

Lemma 1: The duration of the i-th cycle, Ati = tj+i — tj, and the increase in the load over the course of the 
i-th cycle, L(tj_|_i) — L{ti) = L{ti + Ati) — L{ti), are bounded from above by 

At, < CrLiti) and L(ti+i) - L{ti) < CLL{ti), 



for all p<l, where Ct = 1 — + 1 1 r and Cl = 1 ^ r- 

r—' -1 i_p3_pg yi-pQ l-max|p4,p5}y ^ l-max|p4,p5} 

The proof of the above lemma is presented in Appendix E. 

In order to establish that the durations of M4-periods are non-negligible, it will be useful to introduce the notion 
of 'weakly-balanced' queues, ensuring that the queues of nodes 4 and 5 are not too small compared to the queues 
of nodes 3 and 6. 

Deflnition 1: Let and be fixed positive constants. The queues are said to be weakly -balanced in a 

given cycle (with respect to and if P"^^ < < /S'"^^, with t denoting the time when the 

Ml -period ends that initiated the cycle. 

The next lemma shows that over two consecutive cycles, the queues will be weakly-balanced with probability at 
least 1/3. 

Lemma 2: Let 

_ P2 ^ P2I- max{p4, P5} 



2fp2 + (p3 + P6)S^) P 1--WP4,P5} 



-max{p4,p5} 

Then over two consecutive cycles, with probability at least 1/3, the queues will be weakly-balanced in at least one 
of these cycles with 

^max max{p3,/96} + (1 - P2)(l - e)/e 



min{p4,p5} 



and (3""- 



The proof of the above lemma is presented in Appendix E. 
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Fig. 5. A cycle Dk consisting of a pair of consecutive cycles. 



As suggested by the above lemma, it will be convenient to consider pairs of two consecutive cycles in order to 
prove instability of the fluid limit process. 

Let Dk be the pair of cycles consisting of cycles 2k — 1 and 2k as in Figure |5j /c = 1, 2, . . . . With minor abuse 
of notation, denote by = t2fc-i the start time of and Lk = L{Tk). Denote by AT^ = Tk+i — Tk the duration 
of Dyfc and by AL^ = L^+i — the increase in L{t) over the course of Dj^. 

The next proposition shows that for p sufficiently close to 1 the load cannot significantly decrease over a pair of cy- 
cles and will increase by a substantial amount with non-zero-probability. We henceforth assume {pi, p2, P3,P4, /?5, Pe) 
p{ki, K2, K3, K3 — a, KQ — a, kq), with max{Ki, K2} + K3+kq = 1 and < a < min{K3, kq}, so that p = po+P3+P6- 

Proposition 1: Let Clt = Ct{2+Cl), with Ct and Cl as specified in Lemma[T| 6 = 1 — {1 — p)Clt^ P = 1/12. 
Over cycle pairs Dk, k = 1,2, . . . , 

(i) ATk < CLTLk-, 

(ii) L{t) > 9Lk for all t G [Tk,Tk+i]; 

(iii) P(Lfc+i - eLk > 5{p)eLk\Lk) > p, 

with 5{p) a constant, depending on p, and 5{p) -[ 6 = , as p t 1- 

Proof: 

We first show part (i). Using Lemma [T| we find 

ATk = At2k-i + At2k < CT{L{t2k^i) + L{t2k)) < Ct{2 + CL)Lk. 
In order to prove part (ii), note that L{t) cannot decrease at a larger rate than I — p, so that in view of part (i), 

L{t) >Lk-{l-p){t- Tk) >Lk-{l- p)ATk > (1 - (1 - p)CLT)Lk = OLk, 
for all tG [Tk,Tk+i]. 

We now turn to part (iii). Suppose that the following event occurs: the queues are weakly-balanced at the end 
of an Ml -period, say time r, during Dk (which according to Lemma [2]) happens with at least probability 1/3) and 
the system then enters an M4-period (which happens with probability 1/4). Recalling that p^ > p^, Qs{t) > Qi{t), 
P5 < p6 and Q5(t) < Qe{t), we find that during the M4-period L{t) increases by 

pmin I ^"(^^ Q5(r) \ ^ ^ min{Q4(r), Q5(r)} 

\l-pi'l-p5)~ 1 - pmm{K3,KQ} + pa' 

Since the queues are weakly-balanced, we deduce Q3(r) < /3°''"^Q5(t) < /3™''^Q6(-r) < (/3'"''^)2Q4(r) and 
Qeir) < /3"^^"Q4(r) < /^'^^^Qslr) < (/3'^^")2Q5(r). Noting that Qi{t) = Q2{t) = 0, we obtain 

L{r) = Q3(r) + Qeir) < (1 + ^Qeir) < /^'""^(l + mQ^ir), 

and also 

L{r) = Q3(r) + QeW < (1 + mQsir) < ^''''il + mQ5{T). 

So 

L{t) < r^'^'il + m min{Q4(r), Q5(t)}, 
and thus the increase in L{t) during the M4-period is no less than 5{p)L{t), with 

\P> /3max(-x j_ /3max)(l _ pniin{K3, Ke} + po) ' 
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Using part (i) once again, we conclude that with at least probability 1/12, 

Lk+i > Lk + 5{p)LiT) - {1 - p)ATk > Lk + Sip)iLk - (l - p)ATk) - (1 - p)ATk 
= (1 + 5{p)){Lk - (1 - p)ATk) > (1 + d{p))iLk - (1 - p)CLTLk) 
= il + 6ip))eLk. 

m 

Armed with the above proposition, we now proceed to prove that the fluid Umit process is unstable, in the sense 
that L{T) — )• oo as T — )• oo. In fact, L{T) grows faster than any sub-linear function T^, m > 1, as stated in the 
next theorem. 

Theorem 1: For any m > 1, there exists a constant p* = p*{K,m) < 1, such that for all p G (p*, 1], 

T 



lim sup E 

T^oo 



0, 



for any initial state Q(0) with ||Q(0)|| = 1, and ||-|| denoting the Li-norm. 
Proof: 

Consider the cycle pairs D^, A; = 1, 2, . . . , as defined right before Proposition Ml Assume p G (1 — 1], so 
that 9 G (0, 1] in Proposition [T] For any time t > Ti, we can define a stopping timeiVt such that T/v^ < t < T/Vt+i, 
i.e., t is within the A't-th cycle pair. (This is possible almost surely, since — )■ oo as — )• oo almost surely, as 
will be proven below.) Recall that Tjv^+i < Tjy^ + CltLni ^(^) ^ GL^^ by parts (i) and (ii) of Proposition [T| 
respectively, and trivially Ln^ < L(0) + pTjv^ < 2TNt for t sufficiently large. Thus, 

limsupE [tL-'"(t)] < limsupE [rTv^+i^^^L^T*] 

< 0-"" lim sup E [Ttv.L^™] + 6'-™Clt HmsupE [L^^+^j 

t— >oo t—>oo 

< 0(l + 2CLT)limsupE[r^,L-7'] . (1) 

t—^oo 

So it suffices to prove that there exists p* = p*{K,m) < 1 such that ([T]l is zero for p > p* , which we now proceed 
to show. 

First of all, by Proposition [T] for any m > 0, 

< (i-p)(eLfc)-™+p((e + 5)Lfc)-™ 

= aniL'^™', (2) 

where Tk is a suitable filtration and am ■= (1 — p)0~^ + p{6 + 5)~"^. 

Since 9{p) — ^(1) = 1 and 5{p) — 5{1) = J > as p t 1, am{p) is a continuous function of p in the vicinity 
of 1. Because am(l) < 1> there must exist a pj^ = p*{K,m) < 1 such that Om < 1 for all p > p*. This shows 
that, for p > p^, -Z^^™ is a positive (geometric) supermartingale with parameter am < 1. Taking expectations on 
both sides of Q yields 

E [L^-] < a'mL-"^. (3) 

with Lq = L{ti^^) > as noted earlier. In particular, limfc_i.oo E [-Z^^"^] = 0, and l/L^ — > almost surely as A; — oo 
by the Doob's supermartingale-convergence Theorem (page 147 of EH)- This imphes that — >■ oo almost surely 
because < pT^ + 1 < Tfc + 1. Therefore, the stopping time T^^ is well-defined. 
Next, consider the sequence of random variables T^L^^^. Using Proposition [Tj 

E [rfcL-'"|J-fc_i] < {Tk-i + CLTLk-i)E[L-'^\Tk-i] 

= amTk^iL^!^[ + amCLTL^:r{^\ (4) 

Define := CiTOimL^^'^^ , then, by ^ and et is a positive (geometric) super-martingale with parameter 

Um-i < 1 for p > p*„_;l = p*{K,m - 1). Then, J2kLi^i^k] < C'LTOm "m-i < which shows that 
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limfc_i>oo ^fc^fc = almost surely. In particular, define a := max(am, am_i) and p* = max{pj^, then 



taking expectations on both sides of Q yields 

which, by induction, shows that 

K [r,.L--] < a'=-i(E [TiLr'"] + Clt(A: - l)a), 



(5) 



(6) 



for p G (/O*, 1]- Now observe that T\ is strictly bounded and L\ is bounded away from zero, since a natural state 
is reached in finite time, before the system can empty, almost surely. It then follows that limfc_j.oo IE [T^L^™] = 0, 
The fact that T/cL^"* converges in L\ implies that the sequence of random variables TkL'^™' is Uniformly 
Integrable (UI) (page 147, Theorem 50.1 of It therefore follows, by adapting the arguments of Doob's 

optional sampUng theorem (page 159 of ||3ll "). that the family of random variables {Tat^L^™} is also UI. Thus by 
definition, given e > 0, there exists such that 



E 



< e, Vt > 



We deduce 



\TkL^"\Nt = kYi^TN,L~£ < K,} 

oo 

<KeF{Nt<D}+ CLTka^-^ + e. 

k=D+l 



+ e 



Fixing e and D, we find that 



limsupE [TN.Ljr] <{D + 1)-^ 
t— >oo L — a 



+ s 



by the Monotone Convergence Theorem [IJ, and thus, letting — )• oo and e — )• 0, we have lim sup^^^g^^ E [T/v^L]^™ 
for p > p*. 

Corollary 1: For any m > 1, there exists a constant p* = p*{k, m) < 1, such that for all p G {p*, 1], 

limmi — —, — = oo, 

T^oo TV™ 

almost surely for any initial state Q(0) with ||Q(0)|| = 1. 
Proof: 

Note that for any initial state Q(0) with ||Q(0)|| = 1, 

lim inf — > lim inf 



as can be seen from Proposition [TJ and so it suffices to show that limsupj^. Tk+iL^^ = 0. But Tk+i < Tk + CiTLk, 
thus, 



limsupTfc+iL^"^ < lim sup TfcL^'" + CLTlimsupL^ ™+^ 



(V) 



fc— >oo fc— >oo fc— >oo 

The right-hand side is zero because, as we saw in the proof of Theorem [Tj both TkL-"" and L''^^'^ converge to 
zero almost surely for p G {p*{K.,m), 1]. 
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B. Instability of the original stochastic process 

In Theorem [T] we established that the fluid Umit process in unstable, in the sense that L{T) — oo as T — oo. We 
now proceed to show how the instability of the original stochastic process can be deduced from the instability of 
the fluid limit process. The original stochastic process is said to be unstable when {{U{t), X{t))}t>o is transient, 
and ||X(t)|| — )• cxD almost surely for any initial state X{0). 

We will exploit similar arguments as developed in Meyn |[27ll . A notable distinction is that the result in ETl 
requires that a suitable Lyapunov function exhibits strict growth over time. In our setting the fluid limit is random, 
and the growth behavior as stated in Theorem [T] is not strict, but only in expectation and in an asymptotic sense, 
which necessitates a somewhat delicate extension of the arguments in ll27ll . 

The next theorem states the main result of the present paper, indicating that aggressive deactivation functions 
cause the network of Figure [3] to be unstable for load values p sufficiently close to 1. 

Theorem 2: Consider the network of Figure [3} and suppose that fi{x) = 1, x > 1, and gi{x) = o{x '^), with 
7 > 1. Let {pi,p2,p3,pA,P5,P(i) = p{ki,K2,K3,K3 - a, - a,Ke), with max{Ki,K2} + H3 + kq = 1, and 
< a < min{K3, kq}. Then there exists a constant p*{k, a) < 1, such that for all p G {p*{n, a), 1]: 

lim Px(o){liminf ||X(t))|| = 00} = 1. 

Since our Markov Chain is irreducible. Theorem immediately implies that it is transient. The proof of Theorem |2] 
relies on similar arguments as developed in the proof of Theorem 3.2 in [27 1. A crucial role is played by Theorem 3. 1 
of |[27l . which is reproduced below for completeness. 

Theorem 3: Suppose that for a Markov chain {X{n); n = 0, 1, 2, ... } with discrete state space S, there exist 
positive functions W{-) and A(-) on S, and a positive constant cq, such that 

E [W{Xin + 1))| < WiX{n)) - A{X{n)), (8) 

whenever X{n) £ Sc„ = {x £ S : W{x) < cq}, with Tn := cj{X{0), X{1), . . .,X{n)). Then for all x £ S, 

I A{X{n)) < 00 I > 1 - W{x)/co. 

[n=0 J 

In order to apply the above theorem, we need to construct suitable functions W{-) and A(-). The proof details 
are presented in Appendix E. 

Remark 4: Recall that the class of deactivation functions gi{x) = o{x''^) includes the random-capture scheme 
with g{x) = 0, X > 1, as considered in |[T2i . The result in Theorem [2] thus disproves the conjecture that the 
random-capture scheme is throughput-optimal in arbitrary topologies. 

VI. Simulation experiments 

We now discuss the simulation experiments that we have conducted to support and illustrate the analytical 
results. Consider the broken-diamond network as depicted Figure |3] and considered in the previous sections. In the 
simulation experiments, the relative traffic intensities are assumed to be ki = K2 = 0.4, ^3 = 0.4, and kq = 0.2 
with a = 0, for the components Mi, M2, and M3, respectively, with a normalized load of p = 0.97. At each node 
i, the initial queue size is Xi{0) = 500, the activation function is fi{x) = 1, x > I, and the de-activation function 
is gi{x) = (1 + x)^^, where we set 7 = 2. 

Figure [6] plots the evolution of the queue sizes at the various nodes over time, and shows that once a node 
starts transmitting, it will continue to do so until the queue lengths of all nodes in its component have largely been 
cleared. This characteristic, and the associated oscillations in the queues, strongly mirror the qualitative behavior 
displayed by the fluid limit. 

Although Figure [6] suggests an upward trend in the overall queue lengths, the fluctuations make it hard to discern 
a clear picture. Figure [7] therefore plots the evolution of the node-average queue size over time, and reveals a 
distinct growth pattern. Evidently, it is difficult to make any conclusive statements concerning stability/instability 
based on simulation results alone. However, the saw-tooth type growth pattern in Figure [7] demonstrates strong 
signs of instability, and corroborates the qualitative growth behavior exhibited by the fluid limit. Indeed, careful 
inspection of the two figures confirms that the large increments in the node-average queue size occur immediately 
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Fig. 6. Queue sizes at the various nodes as function of time for tlie network of Figure |3] 
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Fig. 7. Node-average queue size as function of time for the network of Figure [3] 



after M4-periods, exactly as predicted by the fluid limit. We further observe that in between these periods, the node- 
average queue size tends to follow a slightly downward trend, consistent with the negative drift of rate (p — l)/3 
in the fluid hmit. 



VII. Concluding remarks and extensions 

We have used fluid limits to demonstrate the potential instability of queue-based random-access algorithms. For the 
sake of transparency, we focused on a specific six-node network and super-linear activity functions. Similar instability 



issues can however arise in a far broader class of interference graphs, as we will discuss in Subsection VII-A below. 



The proof arguments further suggest that instability can in fact occur for any activity factor that grows as a positive 



power 1 /K of the queue length for network sizes of order K, as will be described in Subsection VII-B 



A. Instability in general interference graphs 

The instability of random access, with aggressive de-activation functions, is not restricted to the broken-diamond 
network, and can arise in many other interference graphs. Consider a general interference graph G = {V,E). 
Without loss of generality, we can assume G is connected, because otherwise we can consider each connected 
subgraph separately. For 7 > 1, the fluid limit sample paths still exhibit the sawtooth behavior, i.e., when a 
node starts transmitting, it does not release the channel until its entire queue is cleared (on the fluid scale). Let 
M. = {Ml, . . . , Mk} denote the set of maximal independent sets (maximal schedules) of G. We say the network 
operates in Mj if a subset W C Mi of nodes are served at full rate (on the fluid scale), and W does not belong to any 
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(a) {1}, {2, 3}, {4, 5} (b) {1}, {2, 3, 4}, {5, 6} (c) {1}, {2, 3, 4}, {5, 6} (d) {1}, {2, 3, 4}, {5, 6, 7} 

Fig. 8. A few unstable networks with their unique minimal cover A1* using the maximal schedules. 



Other maximal schedules Mj, j ^ i. Under the random-access algorithm, at any point in time the network operates 
in one of the maximal schedules and switches to another maximal schedule when one or several of the queues in the 
current maximal schedule drain (on the fluid scale). More specifically, assume the network operates in a maximal 
schedule M,. If Mj interferes with all other maximal schedules, i.e., Mj n Mj = for all I < j < K, j i, then a 
transition from Mj to any maximal schedule Mj, j / i, is possible when all the queues in Mj hit zero (on the fluid 
scale). On the other hand, if Mj overlaps with a subset of maximal schedules Ai'- := {Mj G M. : Mj n Mj ^ 0}, 
then the activity process can make a transition to Mj G M!^ when all the queues in Mi\Mj drain (on the fluid 
scale). 

The capacity region of the network is the convex set C = conv(S'), which is full-dimensional because all the basis 
vectors of belong to that set. The incidence vectors of the sets Ai correspond to the extreme points of C as they 
can not be expressed as convex combinations of other points. Consider a covering of F = {1, 2, . . . , N} using the 
maximal schedules. Formally, a set cover C of F is a collection of maximal schedules such that V C UA/,ec^i- A 
set cover C is minimal if removal of any of the elements Mj G C leaves some nodes of V uncovered. Consider the 
class of graphs in which \C\ < K — 1 for some minimal set cover C, i.e., we do not need all Mj's for covering V. 
Without loss of generality, let Ai* = {Mi, M2, . . . , Mk'} denote such a minimal cover with K* < K — I. Consider 



a (strictly positive) vector of arrival rates A 



where ai > 0, I < i < K*, such that J^i^i '^i = 1' 



and < p < 1 is the load factor. Hence, a centralized algorithm can stabilize the network by scheduling each 
Mj G A^* for at least a fraction pcjj of the time. However, under the random-access algorithm, the network might 
spend a non-vanishing fraction of time in the schedules Ai\M* , which can cause instability as p approaches 1. 
This phenomenon is easier to observe in graphs with a unique minimal set cover M.* and with a maximal schedule 
Ml interfering with all the other maximal schedules, hence Mi G A^*. 

This means any valid covering of V must contain Ai*. Therefore, considering arrival rate vectors of the form 



A = '^i^Mi, o"i > 0, Xlili — 1' ^^^y ^'^y ^'^ stabilize the network is to use Mj for a time fraction 

greater than pai. Visits to Mi have to occur infinitely often, otherwise the network is trivially unstable, and at 
the end of such visits, a transition to any other maximal schedule is possible, including the schedules in 
with positive probability. Then, upon entrance to schedules in the network spends a positive time in such 

schedules because the queues in Ai\{Mi} build up during visits to Mi. Hence, the arguments in the instability 
proof of the broken-diamond network can be extended to such networks, although a rigorous proof of the fluid limits 



in such general cases remains a formidable task. Figure VII-A shows a few examples of such unstable networks 
with unique minimal set covers. 



B. Instability for de-activation functions with polynomial decay 

Consider any unstable network G = {V,E), for example the broken-diamond network or a graph as described 
in the previous subsection. Let denote the set of neighbors of node i in G. We construct a k-duplicate graph 
G'^^\ /c G N, of G as follows. For each node i ^ V, add k duplicate nodes d^^\ . . . , d^*^ to the graph, with the same 
arrival rate Aj and the same initial queue length Xj(0), such that each node d^*^ is connected to all the neighbors of 
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node i and their duplicates, i.e., I{dj'^) = '^{i)^i^x{i) {^^i ■> ' ' ' ) ^i'''}' 1 < j < /c- For notational convenience, 

we define of^^ := {i,d!(\ . . . and call it the duplicate collection of node i. Note that the duplicate graph 

has the same number of maximal schedules as the original graph. In fact, each maximal schedule M^^^ of G^^"^ 

(k) (k) 

consists of nodes in the maximal schedule Afj of G and their duplicates, i.e., M- = Ui^MiDi . Next, we show 
that the duplicate graph is unstable for de-activation functions that decay as 0(2;"'^), for 7 > l/{k + 1). Essentially, 
for such a range of 7, each duplicate collection acts as a super node with 7 > 1, i.e., (i) if one of the queues in 

(k) (k) 

a duplicate collection starts growing, all the queues in grow linearly at the same rate Aj (on the fluid 

(k) (k) 

scale), (ii) if a nonempty queue in starts draining, then all the queues in drain at full rate until they all 
hit zero (on the fluid scale). Then the instability follows from that of the original network, as we can simply regard 
the duplicate collections as super nodes. An informal proof of claims (i) and (ii) is presented below. 

Claim (i) is easy to prove as all the queues in a duplicate collection share the same set of conflicting neighbors 
and the fact that one of the queues grows, over a small time interval, implies that some conflicting neighbors are 
transmitting over such interval. To show (ii), note that if one of the queues in the duplicate collection drains over 
a non-zero time interval, no matter how small the interval is, all the conflicting neighbors must be in backoff for 
0{R) units of time in the pre-limit process. This guarantees that all the queues in the duplicate collection will 
start a packet transmission during such interval almost surely. As long as the duplicate collection does not lose the 
channel, each queue of the collection follows the fluid limit trajectory of an M/M/1 queue. Suppose all the queues 
of the duplicate collection are above a level e on the fluid scale for some fixed small e > 0. Thus, in the pre-limit 
process, the amount of time required for the queues to fall below a threshold eR is 0{R) with high probability 
as i? — 00. The duplicate collection loses the channel if and only if all A; + 1 nodes in the collection are in 
backoff and a conflicting node acquires the channel by winning the competition between the backoff timers. The 
probability that a node goes into backoff at the end of a packet transmission is 0{{eR)~'^), or approximately the 
fraction of time that a node spends in backoff is 0{{eR)~^). Therefore, the fraction of time that all A; + 1 nodes of 
the duplicate collection are simultaneously in backoff is 0{{eR)~'^'^') because the nodes in the duplicate collection 
act independently from each other. Therefore, over an interval of duration 0{R), the amount of time that all /c + 1 
nodes are in backoff is 0{R^^^^~^^^^), which goes to zero as i? — )• 00 if 7 > l/{k + 1). Thus, the nodes in the 
duplicate collection follow the fluid limits of an M/M/1 queue until their backlog is below e on the fluid scale. 
Since e could be made arbitrarily small, we can view the duplicate collection as a super node that does not release 
the channel until its backlog hits zero. This demonstrates the instabiUty of fluid limits for the initial queue lengths 
described above for the duplicate network. 

To rigorously prove instability of the original process using the framework of Meyn |[27l . we need to show 
instability of the fluid limit for any initial state. Handling arbitrary initial states for general activity functions and 
interference graphs is more involved than in the specific broken-diamond network considered here. An alternative 
option would be to extend the methodology and develop a proof apparatus where it suffices to show instability of 
the fluid limit for one particular initial state. The framework of Dai [ 6 1 offers the advantage that instability of the 
fluid limit only needs to be shown for an all-empty initial state. However the characterization of the fluid limit for 
an all-empty initial state appears to involve additional complications. 

The above proof arguments suggest that instability can in fact occur for any 7 > as /c can be chosen arbitrarily 
large. This indicates that the growth conditions in Ghaderi & Srikant lITSl are sharp in the sense that backoff 
probabilities of the form o(iog{x)) essentially the most aggressive de-activation functions that guarantee maximum 
stability of queue-based random access in arbitrary graphs. In terms of backoff probabilities ^_^_^^,(x) used in |[T5]| . 
this means the weight functions w{x) = log(l + x)/h{x), where h{x) is an arbitrarily slowly increasing function, 
are essentially the most aggressive weight functions that the random-access algorithm can use while preserving 
maximum stability in general topologies. 
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Appendix A 
Fluid limit proofs: Part A 

A.I. Prelimit model 

We start with the time-homogeneous lUarkov process (U(t), X(t)), t > with state space 5 = S" x Nq^ where 
N = 6 and S C {0,1}^ is the set of feasible activity states, which has already been fully described earlier in 
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Section [II] We recap to state that service times are unit exponential as are backoff periods. In addition the Poisson 
arrival processes are determined by the vector of arrival rates A and the probability of backoff is determined as a 
function of queue length 1/(1 + Q)^ with 7 G (1,cxd). As mentioned earlier, the case 7 = 00 corresponds to the 
random capture algorithm, considered in |[T2l . 

The fluid limit will not be obtained directly from the above process but rather via the jump chain of a uniformized 
version with "clock ticks" from a Poisson clock with constant rate, 

N 

/3 = J] A, + iV, (9) 

£=1 

independent of state, with null (dummy) events introduced as needed. 

With minor abuse of notation, denote by (U(n),X(n)) G 5 to be the state of the jump chain at nth clock 
tick. For our subsequent construction, it will be convenient to replace U(ri) with the cumulative state I(n) = 
X;LoU(ri) G N^, which is by definition increasing. It determines and is determined by the sequence U(n) and 
the associated jump chain is Markov if the state is altered to be (I(n), I(n — 1), X(n)) with I(— 1) = 0. Note that 
the process I(n) counts the number of steps where the queue process is active. It is not a count of the number of 
service completions by step n. 

From the jump chain, we obtain a continuous stochastic process in C[0, 00) by linear interpolation and by 
accelerating time by a factor /3. To be specific, at an arbitrary intermediate time t > between two clock ticks 
ti = {k — 1)/ 13 < t < tu = k/ (3, k £N, the interpolated process takes the values 

Q{t) = f3{tu-t)X{k-l) + f3{t-ti)X{k), 
I(i) = P{tu-t)I{k-l)+f3{t-ti)Iik). 

From this construction we can obtain a sequence of such processes, indexed by i? G N, with the usual fluid limit 
scaling 

{Q^m^it)) = (^Q^'^^^t), ^^^""hm) ■ (10) 

This is obtained together with a corresponding sequence of initial queue lengths 

Q^(0) = iQ^''^(0)^q. (11) 

Recall that the underlying jump chain (U(n), X(n))^>Q is affected only through the initial state. Its transition 
probabilities are unaffected. The convergence in ( [TT| ) is with respect to the Euclidean norm and without loss of 
generality we may take ||q|| = 1. 

For every R and time t > 0, (Q^(t), I^(t)) take values in = x 'K'^, which is therefore the state space of 
the process. E has the usual Euclidean metric and associated topology and we will denote the Borel sets by Be- 
Furthermore the underlying jump chain (U(n), X(n)),^>Q of the uniformized Markov process satisfies the "skip- 
free property" jlTll which ensures that the jumps between states are bounded in Ci. It follows that the interpolated 
paths are Lipschitz continuous with Lipschitz constant 3/3 < 00. This property is conferred on the sample paths 
themselves as stated below 

\\Q^{t,uj) - Q^(s,a;)|| + \\I^{t,uj) - I^{s,oj)\\ < 3/3 (t - s) (12) 

which holds \/lo, < s < t, R £ N. The factor 3 appears since at most two queues can be active at the same time 
and at each clock tick at most one queue can be in(de)cremented. 



To summarize, the scaled sequence of processes as defined in (10 1 take values in the space C[0, 00) of continuous 
paths taking values in E, endowed with the supnorm topology, and cj-algebra C generated by the open sets. This 
is obtained through the usual metric pc as defined in |40|, page 6. This space is both separable and complete, see 
||4P| Theorem 2.1. The probability measure induced on C by the i?th interpolated process ([TOjl is denoted /i/j so 
that ij-r{A) is the probability of an event A £ C. Finally, it is of course the case that the jump chain sequence 
determines and is determined by the corresponding interpolated path. Hence /ijj and the jump chain probabilities 
are equivalent, given the initial conditions. 
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A. II. Fluid limit 

If there is an infinite subsequence, Rk^ , Rk2 > • • • such that =^ /i where =^ denotes weak convergence, then 
fi is said to be a fluid limit measure. If such a fluid limit exists then the corresponding process can be defined as 
follows. Its state space is again E with underlying sample space C[0, oo) and corresponding cj-algebra C generated 
by the open sets under the metric, pc, as mentioned earlier. This is the same space as for the sequence of prelimit 
processes. With the fluid limit measure /x (including the deterministic initial conditions) we have an underlying 
probability space (C[0, oo),C, fi). The stochastic process, (Q, I) is the mapping [0, oo) x C[0, oo) — E with values 
(Q(t, io),I{t, uo)) G E. The curves (Q(., w), I(., w)) and uj itself are the same. Whilst these definitions are somewhat 
redundant, nevertheless in what follows, it will be convenient to think of a sample path as either a point lo or as a 
random function. Finally, on some occasions, we will use the notation X G mC to indicate that X : C[0, oo) — )• M 
is measurable. 

The proof of the next Theorem is standard and follows from Lipschitz continuity. Theorem 8.3 of [1], and Lemma 
3.1 of [40]. The details are omitted for brevity. 

Theorem 4: The sequence of measures /U/j defined on (C[0,oo),C) is tight. 



Thus, it follows from Prohorov's Theorem (Theorem 6.1 of 111) that the sequence pn is relatively compact and 
fluid limit measure p must exist. We suppose without loss of generality that /i/j =^ fi. The sample paths under fi 
have the same Lipschitz constant 3/3. It follows that the sample paths of fi are differentiable a.e., almost surely 

El. 

Lipschitz continuity also implies that there are only a countable number of closed intervals [a,b], < a < b, 
such that Qe{a,uj) = Qe{b,oj) = 0, i = I, - ■ ■ ,N, and Qe{x,uj) > 0,yx e {a,b), £ = ,N, holding almost 

surely. 

We denote by {J^t}t(z[o oo) ' -^t C. C, the filtration of sub cr-algebras generated by the open sets restricted to the 
interval [0, t]. The process (Q, I) is adapted to {J^t}t^[o oo) (I'^ ^^'^^ J"rprogressive as the process is continuous, 

see na). 

By consideration of the weak law of large numbers and the existence of the fluid limit measure /i, it holds that 

Q(t) = Q(0) + At - il(t), t > 0. (13) 

This equation can be thought of as an accounting identity. If queue i is active for a unit interval then increases 
by (3, which corresponds (almost surely) to departures at unit rate. During the same period the arrival rate is of 
course. 



Since Ie{t + h) — Ii{t) < f3h for any node £, and any times t > and /i > 0, it follows from ( 13 1 that 

Q^{t + h)> Qe{t) + Xih - h, fi a.s. (14) 
We now derive an elementary property of the fluid limit process. Given t > 0, h > 0, define 

= : Ie{t + h,co)- hit, uj) = Ph} (15) 

to be the event that queue £ is being served (at maximum rate) during the interval [t,t + h], i.e., the node is fully 
active during the given interval. Since many of the events that we consider later are in terms of activity, we adapt 
the following notation throughout the paper. In the case of ( [T5] ), 

Y,% = J^Ht,h,f3h) (16) 

where the superscript "£" denotes the node, "t" time and "h" duration. "/3/i" is the amount of activity which must 
be met with equality here, as indicated by the subscript The subscript may be replaced by >, >, <, or 
<, depending on the event. 

Lemma 3 (No Conflict Lemma): Let / ^2 G {1, • • • ,N} be two neighbors in the interference graph G, and 
h> 0,t>0, then 

/^{<;.ny,5} = o. (17) 
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Proof: This follows by definition, and the existence of the fluid limit. The event Y^^^ n Y"/^ contradicts the 
inequality that for all t > 0, /i > 0, 

[h^ {t + h,io)- {t, Lo)] + [le^ (t + h,uj)- (t, uj)] < I3h, 

which holds ^ almost surely. ■ 
To obtain more detailed information with respect to the sample paths of fi, we proceed to the construction of 
sequences of stopping times. 



A.m. Sequences of stopping times 

The following definition is in connection with the amount of time a sample path for Qi is positive, immediately 
prior to a time z > 0. 

Definition 2: Given a time z > 0, and v,0 < v < z, and an ^ = 1, • • • , N, define 

i^g = W ■■ Qe{z-s,uj) > 0, Vs G {0,v)}. 

In words, Ki^)j is the set of sample paths for which are strictly positive in the interval {z — v,z); if z = 0, Ki^l 
is taken to be 0. 

Observe that it could be the case that either Qe{z, w) = or Q£{z — v,uj) = (or both) and still u G i^if^. Finally 
note that it is possible for a given lu that no such v can be found, which requires that Qi{z,u;) = on account of 
continuity. It can be shown that 

^IS = n„;2/n<^, [U^=i : Qiiz -q,uj)> l/m, q G [l/n,v - l/n] H Q}] G T„ 
for z > 0, where Q is the set of rational numbers. 



Given a time z > anc 
sup : w G U{0} 
if z > u > then 



a path oj, we define the mapping A^^\z,uj) : C[0,oo) ^ [0,z] to be A^^\z,uj) = 
, which is the time for which was positive immediately prior to z. By definition. 



{u::A(^\z,u)>u}=K(J:1 



from which it follows that A^^\z,uj) G mTz- So far z has been fixed. However A^^") : [0,oo) x C[0,cxd) — M+ 
is a stochastic process carried by the underlying probability space {C[0, oo), C, fi) and J^j-adapted as we have just 
seen. This process is piecewise linear and left-continuous (It falls to immediately after Q£ returns to from 
being positive). It follows that A^^^ is J^t -progressive, see for example [10|. We are now in a position to make the 
following definition. 

Definition 3: Given an Tt stopping time a, a queue i £ 1, • " " and m £ = Z — {0}, define Ti^miuj, a) : 
C[0,oo) X [0,oo] — > [0, oo] as follows 

Ti^rn{^^,cr) = inf ^z > a{u}) : Qi{z) = 0,A^^\z,uj) G (em,/m]} < oo, 

where 

fm = em = — ^—r; for m G Zq, m > 0, 

m 171 + 1 

fm = — M, em = l^^l; for m G Zq, m < 0, 
where again empty sets have an infinite infimum. 

In words, is the earliest right-hand end of an open interval, with value z, such that Qi is positive for a period 
A^^\z, uj) G (cm, fm], immediately prior to T^.^. If z — fm is the first time prior to z that Qi = 0, then z is in the 
set on the RHS. However, if this occurs at z — e-m, this is not the case. 

It is plausible that m is also an Tt stopping time, and we will subsequently prove this with particular choices 
for a. We now state a construction lemma using a sequence of stopping times. These are returns to following a 
fixed positive interval, in which we wait for a particular event A^ to occur. 
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Lemma 4 (Stop and Look Back): Let o" > be an stopping time and a > a constant. Proposition 1.5 in 
Ethier & Kurtz BlOl ensures that the following inductively defined sequence is a sequence of Ft stopping times: 

So, Sl, S2, ■ ■ •, 

SO = a (18) 
Sk = 7-c({0},Sfc_i + a), /;; = 1,2,--- 

Here, given an Ft stopping time ai > 0, Tc({0} , cji) = inf {t > ui, Q{t, u) = 0}. Now let Ak G Fg^ ,k = 1,2, . . . 
be a sequence of events in the pre-T cj-algebras of the above stopping time sequence. Finally, define r = if Aj^ 
occurs for the first time at step k and r = oo otherwise. Then r is an Ft stopping time. 

Note that we do not check to see if Af^ has occurred if = oo at any stage, as r is assigned this value regardless. 

We now proceed to show the following. 

Lemma 5: Let ctq > be an Ft stopping time such that Q£{ao{uj),u:) = or fio = oo and suppose i,m are 
given. Let a = Cm and a = a + which is therefore an Ft stopping time, and be the mapping given in 
Definition [3] Then Ti^m{^,(^) is an Ft stopping time. 

Proof: Given a we will obtain a sequence of stopping times as in the first part of Lemma |4] However as we 
have already discussed, A^^^ is -progressive, from which it follows by Proposition 1.4 of ifTOll that 

Ak := A^^^ {sk{uj),oj) e mF,^ , V A: = 1, 2, 3, . . . 

so that A^^\sk{ij^),i-^) G (em; fm] £ ^Sk- Hence r as defined in Lemma |4] is an Ft stopping time. 

It remains to show that r coincides with ^ as defined. First suppose r < 00, and immediately, r > 
Qti'T) ^) = 0, A^^\t, uj) € (cm, fm] by definition. The fact that there is no earlier time satisfying these conditions 
follows since each s/j is a zero of Qi and the construction rules out that the event could have taken place any 
earlier. The case r = 00 coincides with there being no zero satisfying the required conditions. ■ 
We now make the following recursive definitions. 

Definition 4: Given m G Zq and queue £ G {1, • • • , A^}, let tq be the first entry of Qi{t,ui) into (tq is an Ft 
stopping time). Then q is defined as 

Zi_o = 7£,m(w,0); if QKO,w) = 

^i,0 = if Qt{^,^) > 0, To G {Cm, fm] 

Z^Q = r£,m(w,To); if Q£{0,UJ) > 0, To ^ (em,/m], 
and subsequent stopping times are defined as 

^m,n = ^£,m(w, Z^^^_i), n = 1, 2, 3, 

The value of the stopping time is taken to be oo if the events do not occur. With obvious notation, we also define 

<„M = ^W(Zi,„,a;) 

to be the actual amount of time that the queue £ is positive prior to Zf^ and A^^ „ = oo in case Z^ „ = oo. 
Finally define the time at which Q£ last enters (0, oo) prior to Z^ „ to be 

" m,n ^m,n ^m,n' 

when Z^ „ < °o and n = °^ otherwise. Note that „ G mFz^^ and is thus a non-negative random variable 
but not a stopping time. 

The following corollary follows immediately from Lemma |5] and Definition |4] 

Corollary 2: Z^ n G Nq is a strictly increasing sequence of Ft stopping times, y£ e N,m £ Zq. 

This completes our goal of constructing sequences of stopping times for the queue processes. For any queue £, 
by construction and by Lipschitz continuity, it follows that the set of stopping times, Z^ „ determine all intervals 
where Qi is positive for any sample path almost surely. 

For each m G Zq, and £ G {1, • • • , N}, define 

BL = sup „ : Z5,^„ < ooj 

to be the supremum of the finite stopping times for positive intervals with duration in (em, fm]- If there is an m 
such that i?^ = oo, then Qg returns to infinitely often. Otherwise there is a B > 0,B > Bf^,\/m e Zq. In this 
case, either Qi remains at as t — )■ oo, or queue £ never returns to 0. 
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A.rV. Piecewise linearity and no backoff until empty 

So far the backoff exponent 7 > 1 has not been taken into consideration, but from now on it will be. The 
following lemma bounds the probability, for the jump chain, that node i has a backoff before its queue gets "small" 
provided that it was active earlier. Given some number Xt G N define, 

Kx^ = {3ra : Xe{k) > Xt, < /c < n, Ui{n) = 0, Uein - 1) = 1} 

to be the event that queue £ has remained above Qt and has had a backoff at step n. We then have the following 
lemma, 

Lemma 6 (No Early Backoff): Given any Xq > Xt, 

1 °° 1 

F{KxjX,{0) > Xo} < 3—^ X J2 = ^x^- (19) 

Since the sum is convergent, 4- as Xt t co. 
Proof: It is convenient to consider the packets being served in generations. That is given a target packet, 
suppose that we serve the packets which arrive during its service with preemptive priority up to and including the 
target packet. This makes no difference to queue behaviour as the service times are exponential and we are only 
interested in the first occasion when node £ goes into backoff. 

Suppose there are Xt > packets in queue at the time the service of a given target packet starts. Consider the 
busy period of this packet, i.e. the time to serve the target packet and the subsequent high-priority packets (without 
backoff). It is easy to see that the mean number of packet arrivals during this busy period is y^^, including the 
target packet itself. 

The service of each packet ends with a random decision to backoff with probability less than (^i^x^y , since 
the queue length is never shorter than Xt until the target packet has departed. Thus, by the union bound, the 
probability of a backoff occurring before or immediately after the target packet departs, is less than n+x-r)-^ ^ 
The probability of a backoff, starting with Xq > Xt packets, and before the queue drops below the level Xt, is 
therefore smaller than Ylr=XT {i+r)-^ which implies the statement of Lemma. 

■ 

The following lemma will also be useful. First given times t2 > ti > on the fluid scale, let B£{[ti,t2]) be the 
event that node £ starts a backoff in the interval [ti,t2]- This event occurs in the prelimit process (^Qf,!^) if for 
some jump chain index n, Ui{n) = 1, ?7f(n + 1) = with [i?ti/3J < n < [i?t2/3l- Let ^^^^([ti, f2])be the event 
that Qf{u) > q (or equivalently Q^{Ru) > Re,) for all u in the interval [ii,i2]- 

Lemma 7: Given the above definitions, 

lim fXR {Be[ti,t2] n De,,{[ti,t2])} = (20) 

it— >oo 

Proof: First we may suppose node i becomes active at some stage or there is nothing to prove. The lemma 
then follows from the union bound. Since there are at most Rti,t2 = \R{t2 — ti)Pi~\ + 2 departures in the entire 
interval, the union bound implies that the probability of a backoff is smaller than. 



fiR{Be[h,t2]nDe,,{[ti,t2])} < (iqp^ 



0. 



This completes the proof. ■ 
Definition 5: Given a queue £, a time t € [0, 00) on the fluid scale, and a queue length Qi{t) = Q > 0, we say 
that t is a point of increase for the activity process of queue i if the event 



p/,3 = n^=J j(f)(i,^,0)^nQ,_Q 



occurs, with Q^^q = {uo : Qi{t,ui) > Q}. In words, queue £ is active in any arbitrarily small interval {t,t + 1/M) 
and Qe is greater than Q at time t. 

Furthermore, given a time s G [0, 00) and /i > 0, we say that queue £ is under active, with duration /i > if the 
following event occurs 

G'fl = /^\s,h,ph). (21) 
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Points of increase rule out that there is a sequence tn it such that uj) = Ii{t, uj), as there is activity no matter 
how small the interval. Under activity means that there was some idling during the interval. Given our choice of 
7, it will be shown that a point of increase cannot be followed by a period of under activity until queue Qi has 
drained. This is because the probability of even a single backoff once service has begun, is effectively until the 
queue has drained on the fluid scale. 

Lemma 8: Suppose s £ {t,t + Q/{1 — A^)). Then V/i, < h < t + Q/{1 — Xe) — s, and for all sufficiently large 
M, 

IS { (t, l/M, 0) n Qi^^ n Gil) = 0. (22) 

Proof: Consider the sequence of prelimit processes. We will choose M large enough and small enough so 
that [s,s + h] C (t + 1 /M, t + (Q - ?) /(I - A^)] (for some small constant <i > 0). Then for R, M sufficiently large, 
and then by definition, occurrence of G^^j^, for the R-th prelimit process, implies occurrence of Bi{[t + 1/M, s + h]). 
Hence we obtain, 

liR[j^\t,l/M,0)nQ\%nGfl} < iiR[/^\t,l/M,0)nQ[%nBi{[t + l/M,s + h])] (23) 

where 

i^B,R = m { (t, l/M, 0) n {t + l/M, s + h)r^ D,^,{[t, s + /i])} , (24) 

and 

i^F,D,R = m {gS'<^ n s + h])f] . (25) 

Thus, in order to prove the lemma, it is sufficient to show that both ijlb,r and hf,d,r — )• 0, as i? — oo, 
because then we may conclude that 

/i {4\t, l/M, 0) n Qf}^ n Gi%} < liminf {j^\t, l/M, 0) n Q^J;l n Gi%} = 

on applying Theorem 2.1 in lUl and since the sets J^\t, l/M, 0), qJ^^, G^^ are all open. 



(t) 

The fact that hf,d,r follows from (13l and then by definition of Qlq and additionally by the choice of 

s,h,c;. As far as fiB,R is concerned, the event J^\t,l/M,0) implies that service has started during the interval 
[t, t + l/M]. On the other hand, the event Bi{[t + l/M, s + h]) implies that at some time in [t, s + h] node £ starts 
to backoff. Setting ti = t and t2 = s + h, we may invoke Lemma |7] as by definition the event L)^ <^([t, s + h]) 
implies Qi did not go below ? in the interval [ti, 12]. It follows that fiB,R — )• as required. ■ 
The impUcation of Lemma [8] is that any positive period of transmission, no matter how short, must be followed 
by full activity until the queue has drained on the fluid scale. This implies that there is no period of under activity, 
until the queue has drained, with probability 1. 

A. V. Piecewise linear paths wUh probability 1 

The aim of this section is to show that the queue sample paths follow a certain bilinear path during the interval 
prior to the queue becoming zero again. The bilinear path depends on the duration of the interval and on the arrival 
rate for the given queue. 

To make the above statements precise, given £ G {1, • • • , A^} define the bilinear path ^to,ti for the interval [to, ii] 
to be, 

$^ {s-]-[ ^ds-to)] to<s<so, 

where sq = ti — Xi{ti — to)- In words, Qi builds up linearly in the interval [to,so] at rate Xi and drains at rate 
1 — A^ in the interval [so,ti]. 
Given rj > 0, and ^ G {1, • • • , A^}, define l^^'f^^ to be the indicator for the event 

lu : sup \Qe{s,u}) -<^l^tM\ <v\ ^ ^t, 

I s£[toM I 
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In words, Ij^'^f^^ (<^) = 1 iff the absolute difference between <I>|^ and the sample path for Qi is smaller than rj in 
supnorm over the interval [toj^i]- 

We now examine the conditional probability that l^yP (a;) = 1, given ^m,n < °^ ^i^^ A^^ „ (the case 

^L,n = oo is irrelevant). Define, = a {Zf^ .^, C C and also = „ n {w : „(a;) < oo}. 

It will be enough to show that the sample paths lie in an arbitrarily small tube around conditional on 

^m,n>^i,n lying in some small rectangle = {u : A\^^^{iS) G (a, 6], „(a;) G (s,t]} G zl^n- 

Theorem 5: Given n > 1, m G Zq, then Vry > 0, 

In words, given the stopping time „ and the time prior to this that Qi was positive, A^^ „, the probability that 
^ye is followed, starting at „ and ending at „, is 1 under the fluid limit measure fi. 

Proof: For any given e > 0, the sets zj^'^'^^ < s < t, < a < b, < t — s,b — a < e, are a vr-system ||2l 

(i.e. closed under finite intersections) and which generate Zm%- Hence we only need to show that 



for suitably chosen e given r] > 0. 

Let B^^{io) < Af^ „ be the additional time, following strict entry of into (0, oo) at „, until the first point 
of increase of is reached. -B^ „ G mT^e as can be seen on consideration of its definition, 

Bi^,X^) = mf[ue{0,Al^,X^))nQ ■.Ie{Vi^^ + u,u)-Ie{Vi^,„u)>0}, (28) 
when „ < oo. 

By definition of -B^„, Lemma jsj and then (13), we may deduce that for uj G z|"'^'j^ 

+ = Xeu, u£[0,Bi,^{u)], (29) 

<5K^m,nH + «,w) = XeBi^M - (1 - Xi){u - Bi^J, u G "^'^^^ ], 

jjL almost surely. Moreover B^^{uj) must satisfy 

5^ ^ (cj) 

i — s + 6 > — — - — > s — t + a, fi a.s. 
I — Xi 

in order to reach in [s,t\. 

Therefore, given any r/ > 0, we may choose > such that for all v G [s—b, t—a], z G [s, t] with b—a, t—s < En 

sup \Qe{u,uj) - ^i^^{u)\ < r], 

u&[v,z] 

^ almost surely, using Lipschitz continuity. Since uj G z|°'^'j^ implies „ G [s — b,t — a], „ G [s, t], we obtain 
that 

^{i^fl,,_{.) = i-z^;^^ 

for all such a,b,s,t as required. ■ 
A similar result can be obtained when n = 0, where the possibility occurs that Qe{V^Q) > 0. 
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A.VI. Brief discussion of results 

Theorem |5] applies to general networks and relies only on the assumption that 7 > 1. The theorem implies that 
the sample paths are more or less determined given the sequences of stopping times „. Only in the case where 
the (finite) stopping times have a common upper bound is the process not completely defined, as otherwise the 
queue returns to infinitely often, determining the path completely. If there is such a bound, either the queue 
remains at 0, or increases linearly, as there can be no subsequent point of increase of I^. 

Indeed, since there are only countably many stopping times, and since for each finite „ < 00 the queue 
sample paths follow for some finite interval with probability 1, we may confine sample path realizations to 
countable successions of such intervals. These either determine the entire sample path; or the queue remains at 
following the final return; or as the final alternative, the queue remains zero for some interval and then increases 
linearly at rate thereafter. We define the set of such sample paths by P C C[0, 00). The probability of any event 
F G C can as well be taken as 

/z{F}=/i{FnP}, 

and, therefore, we suppose that the probability space is defined on {P,Cp) with topology relativized in the usual 
way to P which is a subset of C[0, 00). This establishes that the queue-length trajectory of each of the individual 
nodes exhibits sawtooth behavior in the fluid limit. This concludes Part A. 

In Part B, we will show that we can in fact confine ourselves to a smaller set of paths which reflect the constraints 
resulting from the underlying interference graph. 



Appendix B 
Fluid limit proofs: Part B 

B.I. No idling property and zero delay capture 

From Lemma [3j it follows that if queue 2 is draining, then queues 3, 4, 5, 6 are increasing linearly. However, 
we also expect that queue 1 is either draining or remaining at until time t, and this is indeed the case as we now 
show. 

More generally, given a node £, let be the set of its interfering nodes, i.e. the set of its neighbors in the 
interference graph G. The following lemma shows that if Q(,{s) > Q, and all its interferers are idle in some 
interval [s, t] then node i is fully active until its queue drains. 

Lemma 9 (No Idling Property): Given a node £ with interference set 2^ and an interval [s,t], define 



Di'}=njex,J^Hs,t-s,0), 



that is, no activity for any node in Zi during [s,t]. Further, given Q > 0, define h^flq = Q/(l — ^e) A {t — s) so 
that the queue at most empties over this period, and let 

which implies that node i is under active. Then 



f^{DSnsSnQi%} = o, 



where Q^q is the event {uj : Qi{s,uj) > Q}, as defined earUer. 
Proof: 

Given n G N such that n > l/(t — s), fix an arbitrary (, < ( < 7^ (Recall that N is the number of nodes in 
the network). Clearly, 

Di'} C Dfl := n,exJJ\s,l/nX/n). 
Hence, for arbitrary en > depending on n, to be fixed later, 

Df} C ji'\s,l/n,0)U [j^\s,l/n,en)nDg) . 
Next, observe that for all G N sufficiently large. 
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with Gn = G^^^ (i) _ , and as defined in (m]. The union bound thus implies that 

s+2/n,h^ ^ Q — 2/n > | | 



^ [oi'} n si'} nQi%} < J] /X {g„ n Qi% n i/n, o)} (30) 

n>ns 

+ E/^H>j?(.,i/n,e„)ngi^;j}. 

rt>ns 

Provided is sufficiently large, each term in the first sum must be 0, else Lemma [8] is contradicted. To complete 
the proof, it is therefore sufficient to show that each of the terms in the second sum is as well by suitable choice 
of e„. 

Given n, it is sufficient to find e„ > so that 

^lim i^n {d[1 n J?(s, l/n, 6„) n Qi%} = 0, 

because -D^^^, J<\s, l/n,e), and Q^^q are all open, so that Theorem 2.1 [1] implies that 

l^{Dlln/^\s,l/n,en)nQi%} =0. 

The event ^ implies that there must have been at least 

^ (1 - iVC) > f (31) 
n In 

steps in the jump chain (if we allow for no overlap between active periods and since \T(\ < N) at which all queues 
in Z£ are in backoff for the interval [s, s + l/n]. Also, 

> Q - - > ? > 0, (32) 
n 

throughout [s, s + l/n] since there can be at most R(3/n departures. 

But if (31 1 occurs, we may suppose that node i becomes active within Rl3/{An) such steps, as the probability 
converges to 1 as i? — )• oo that it does so. But if we take < e„ < /3/ (4n) the implication is that there is a 
subsequent backoff. Since (32) also occurs. Lemma |7] with ti = s,t2 = s + l/n and ? above shows that the 
probability of a subsequent backoff goes to which establishes the result. ■ 

Since s, t, Q are arbitrary in Lemma |9} it follows from continuity that node i begins service the instant its 
interferers become idle, if it has a positive queue-length. 

Lemmas |3] and |9] carry an implication for the node pairs (1, 2), (3, 4), (5, 6) in our network. We say that node £i 
dominates node £2, h 7^ ^2 if — -^^i- Hence, if (say) queue 3 (the dominant queue) is draining, then no other 
queue than 4 may be active as a consequence of Lemma |3] But this implies all interferers of queue 4 are inactive. 
Hence, if Q4 > 0, it will therefore begin to drain immediately, i.e. if queue 3 is draining so is queue 4. Also if Q4 
becomes before Qs, then it must remain at 0, until queue 3 drains. 

This result is formally stated in the following corollary, the proof of which is omitted for brevity. 

Given any node A: G {1, • • • , N}, Qk > 0, and time t define, 

"^wM = [Qk -{u-t){l- A,,)]+ , u>t, (33) 

and given v > t, let F^^^^^ be the event that Qk(t u))('^) ~ Qk{u,uj)\ < r/ for n G [t,v]. 

Corollary 3: Given a queue i, let k be any other queue with 1^ ^ Vt > 0, Q > 0, ?y > 0, define v = 



t + Q/{l- Xe), then with p/g as in Definition |5| it holds that, 

,.{/;Sn(f;W)7 = o. 

Corollary [3] implies that fj, almost surely the dominated node k follows the moment that dominating node £ 
becomes active. 
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In case the arrival rates satisfy, 

Ai = A2 = A > (34) 
A4 = A5 
Ag > A5 
A3 > A4 

Corollary |3] may be used to show that the network enters a natural state (as defined in Section fV]) jj, a.s. This result 
is proved in the following theorem. 

Theorem 6 (Almost Sure Natural State): Given the initial condition Q(0) = q with ||q|| = 1, there exits a 
Tjv > such that n a.s. for all t > Tn, 



Moreover (recalling the definition of p given in section IV 1 3p* < 1 such that for all p G [p* , 1), \/iQi{Tiy) > 
i.e. the network is non-empty at time T/v- 

Proof: This result follows from Lipschitz continuity and more particularly from the fact that the sample paths 
are piecewise linear. Hence, apart from a set of measure 0, the derivatives of all queue lengths exist. 
Consider now nodes 3 and 4. Where the derivatives exist and (^4 > 0, it holds that 

~dt~ ~df' 

since A3 > A4 and since Q4 is decreasing at linear rate whenever Q4 > and Q3 is decreasing at a linear rate, as 
shown in Lemma |9] We may therefore deduce p a.s. and where differentiability holds that, 

^ < A4 - A3 < U, 

until some time T3, such that [Q^it) — Q3{t)]^ = 0, t > T^. The same holds for queues 5 and 6, with corresponding 
time Tq and the following inequalities are satisfied, 

[Q4(o)-Q3(o)]+ ^ ^ [Q5(0)-Q6(0)]+ 

A3 — A4 Xq — A5 

We may therefore take 

Tjv = T3 V n, 

and by taking worst case values in the above inequalities, we obtain a uniform bound on T/v. This concludes the 
first part of the lemma. 

We now show that Te, the time to empty, can be taken arbitrarily large. Define Lp{t) = max (52(i)) + 

Q^{t) + Qe{t)- Then Lp can be reduced at most at rate 1, since service of nodes (1, 2), 3 and 6 is mutually 
exclusive, and grows at rate p = po + P3 + pe, which can be made arbitrarily close to 1. Hence Tj; — )• 00 as 
p t 1 if Lp{0) > 0. It can be the case that Lp(0) = but then (34(0) + (55(0) = 1, so that Lp{l/2) = po/2 and 
Te>1{i+ and again ^ 00 as p t 1- ■ 

This shows that a non-empty natural state can be reached in finite time, because of the dominance property. 
Given Theorem |6] we can and will suppose that the state is natural at time 0, without loss of generality. 

We define the set of paths which additionally satisfy the constraints of Lemmas [5] and |9] to be C P C C[0, 00). 
As previously, we now restrict the set of sample paths to Pi, so that the probability of an event F £ C can be 
determined as p{F} = p{F n Pl}- This concludes Part B. 



32 



B.II. Discussion 



We now give a largely informal description of the paths in Pl. Section IV- A gives a detailed description of 
the periods Mk,k = 1,2,3,4. The ends of periods Mi, M2, M3 are marked by the corresponding stopping times 
Zm',n , Zm^n, zin^n- For M4 pcriods, the following construction is needed. (It is needed because stopping times 
may be part of an M2 period and hence do not mark the end of a M4 period.) 



We first define Pr 



m,n 



definition of Bm n in (28 1) 



(4) 



S mT to be the time prior to Zm,n when service begins (recall the 



Definition 6: A stopping time Zm'n is a 



r(5) 



4 M^^' 

Stopping time, denoted Zm,n'^ 



if the following holds, 



Q5iz, 

h{Zt 



4 



p(4) 
^ m,n 

p(4) 



> 



QiiZ', 

h{Z^. 



4 



p(4) ^ 

^ m,n)i 

? = 3,6. 



(35) 
(36) 



That Z\ 



4,M. 



(5) 



is an stopping time follows as both the above events lie in F 



This is consistent with an Af4-period taking place in which queue 4 emptied first (or at the same time as queue 5) 



(5) 

by (35 1. If this is a strict inequality then we say this is a strict stopping time. (36 1 ensures that queue 5 is 



being served throughout [P, 



(4) ^(4) 



as a consequence of Lemma 



Similary we may define Z, 



5,A/| 



It is also possible that some subset of queues are all empty with the remaining queues growing linearly. For 
example, at the end of an Afi-period, it could be the case that both queues 1 and 2 remain at 0, whilst the other 
queues continue to grow linearly. Similarly, it could be the case that all of queues 3,4,5,6 become and remain 
whilst queues 1 and 2 grow at rate Ai. In Part C, we will derive the probabilities according to which one period 
is followed by another with no delay (on the fluid scale) in switching from one period to the next. We concentrate 
on the case of switching out of Mi where the probability of the next period depends only on the residual backoff 
times. 



Appendix C 
Fluid limit proofs: Part C 

We begin with some preliminary results. The first is for measures constructed from closed continuity sets. Given 
a set of sample paths G, define the improper probability measures, 

f,G{F} = fi{FnG}, fi'^^\F)=fiR{FnG}. 

( fi^ 

The following lemma shows that weak convergence is conferred on fi^ provided G is closed and a /i-continuity 
set. 

Lemma 10: Suppose n^^^ is a sequence of probability measures on a metric space, {^},F), such that 

where fi is also a probability measure on the same space. Let G € F he closed and a /^-continuity set. Then it 
holds that 

In particular, the weak convergence definitions (iii), (iv), and (v), in Theorem 2.1 of 01, all equivalently hold. 

The next lemma is concerned with the following. Suppose a pair of non-interfering queues in the network are 
operating in isolation e.g. queues (1,2). Then each queue will be empty and in fact will then subsequently be empty 
infinitely often, almost surely. Given that the evolutions of the two queues are independent, it is plausible that the 
total number of steps in the jump chain for which both queues are backed off together increases to infinity in a 
period which is negligible on the fluid scale. 

Given a start time taken to be 0, define W^{u) to be the total number of steps that queues 1 and 2 are both in 
backoff, starting at time and ending at time u > on the fluid scale, in (Q^(t), Partial periods between 

one clock tick and the next, at the start and at the end are neglected. The following lemma supposes queues 1 and 
2 are in isolation so that no other nodes may gain the medium. 
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Lemma 11 (Total Backoff): Given Q > 0, define t = Q/{1 — X), and suppose that Qf (0) <Q, £ = l,2, and 
both queues are active at time 0. Then for any Q,^ > 0, 



lim fin \w^{t + 2^) > 2Vr\ = 1. 



Proof: Let tq^o be the stopping index in the jump chain for the first occurrence of 

Xi(ro,o) = X2(to,o) = 0. (37) 

Given any ^ > 0, define pfg = P{to,o < [l3{t + £,)R\ \Xe{0) < RQ}. It will be enough to show that pfg 1 as 
i? — )• oo. To see this, note that any queue in isolation is positive recurrent, as a consequence of Lemma Thus, the 
jump chain restricted to nodes 1 and 2 in isolation (i.e., with remaining queues barred from gaining the medium) 



is also positive recurrent. Let mo be the mean number of steps between indices k such that ( 37 1 is again satisfied. 
Also let be the random number of such steps in the next interval of [I3^R\ steps. It is easily seen from the 
weak law of large numbers that 



which implies the statement of Lemma. 

Thus, to complete the proof, we just need to show that p^g — 1. Fix sxt > and choose Xt ■= Xt{X, 7) < oo 



as in ( 19 1 so that the probability of even a single backoff before either queue reaches Xt is no more than ex^ 
Moreover let tt/,£ = 1,2 be the stopping indices for X£{tt/) = Xt- Then, given any r] > 0, and e/j ,, > 0, it 
can be seen that tt^i V tt^2 < + t]) occurs with probability larger than 1 — 2e/j^^ — 2eQ^, with e^.^ — as 
i? — >• 00 by the weak law of large numbers. 

Next, given any el > 0, there exists a Xl large enough such that F{X£{TT^e + k) < Xl} > I — sl for all 
k £ N. This follows from the fact that the jump chain in isolation is positive recurrent, and thus the corresponding 
sequence of infinite probability vectors is tight as they are converging to the steady-state distribution. Hence, with 
probability larger than 1 - 2en,r, - 2exr - 2eL, Xe{ll3R{t + r])\ < Xl,£ = 1, 2. 

Moreover, again by the positive recurrence of the isolated jump chain, the mean number of steps for queues 
1 and 2 both to become 0, starting from any state with Xi < Xi, £ = 1,2, is bounded by some constant 
rriL := mL{XL) < 00. Thus, by Markov's inequality, with a probability less than than mL/{7]R), in a further r]R 
steps both queues will become (and thus inactive). 

Finally, given any e > 0, choose Xt and Xl large enough so that ext < e/8 and el < e/8 and then R sufficiently 
large so that Efi,ri < e/8 and mL/{rjR) < e/8. Hence, with probability larger than 1 — e, ro,o < {t + 2r])R for all 
R sufficiently large. Since e and r] are arbitrary, the proof is complete. ■ 



C.I. Transition from an Mi-period 

In what follows we will further suppose that the lengths of queues 1 and 2 and their activity are both equal, as 
the following arguments are readily modified where this is not the case. We therefore denote their common queue 
length as Q{u) = Qi{u) = Q2{u) in what follows and similarly for the activity I{u) = Ii{u) = hiu). Finally, in 
the following t, c and hence s are fixed. 



5k = OfcC, < Ofc < 1, A; = 0, 1, 
h = vc, 

C = xc, > X > 0, 

for some small positive constants Uk, v, and x to be determined later. We are now ready to define the following 
closed set of paths, 

Gc^t = {w : < c - 5o < Q(s, l^) < c + 81} r\ {uj : I{s + h,uj) - I{s, u) > /3(/i - C)} • (38) 
Gc,t is constructed to correspond to an Mi -period. 



34 









r; 

H:,t 












c 




y(C,t) 

3,4 


1 1 


1 1 1 


s s+h 


t t t 





Fig. 9. Sample Paths for the sets Gc.t and Ic^j'^'- 



Now given < si < S2, and t (which will be specified later), define 

ig-') = Jf )(t + SUS2- SI,P{S2 - Si)) n jL^\t + Sl,S2- Si, /3(S2 "Si)). (39) 

Ic^t^^ is a (closed) set of paths for which queue 3 (and also queue 4) are fully active during the interval [t+si,t+S2]- 
Similar definitions, using the same si, S2, and i, can be made for /^^'^\/^^/^\ 

The first set of paths, Gc,t, is illustrated in the dashed lines in Figure |9] Note all sample paths must pass through 
the interval [c — 6q,c + 6i] at time s, but may continue to increase for a brief period at the beginning. After s + h 
the two queues must be draining at rate 1 — A almost surely as shown in Lemma [8] The red interval to the right 
indicates periods where one of the other three queue pairs are expected to have the medium during the interval 
[t + si,t + 82]- Only one such pair will be active during this period as a result of the forthcoming construction. 

The following is the earliest time that queues 1 and 2 can drain if the sample paths are constrained to lie in Gc,t, 

t = t-r^C. (40) 
As far as additional queue build up is concerned, under the fluid limit, 

Q{s + h,uj) < Q{s, uj) + \h = Q{s, w) + Az/c 



holds for sample paths in Gc,t (see (|T3|). It then follows that queues 1 and 2 will reach under the fluid limit no 
later than 

t = t+ (41) 

which is the definition for t. We thus conclude that, under the fluid limit, queues 1 and 2 will reach in the interval 
{t,t) (for the first time after s + h on occurrence of the event Gc^t)- We formalize the above in the following lemma. 

Lemma 12 (Queue Bounds): Let r^^ = Tc{s, {0}) = inf {t > s : Q{t) = 0} be the first contact time with for 
Q = Qi = Q2- Then, 

/i{G,,tn{^:rO,M0[t,t]}}=O. 

Additionally, Wl = 3, 4, 5, 6, 

fi {Gc,t n {u : Qe{t, oj) < AtXe}} = 0, (42) 

where, 

At + t-{s + h) = c{l-ao- v{l - A))/(l - A). 

Proof: By definition of Gc,t, Q{s,uj) > c — 6o,\/u: G Gc,t- It follows that Q cannot reach before t, as sample 
paths by definition lie in Pi (see Part A. VI, following Theorem [s]). A similar argument applies to t. 

For the last part. Lemma [3j shows that nodes 3,4,5,6 must be idle in the period [s + h,t]. Since the sample 
paths are restricted to lie in P^, it follows that their queues must satisfy the stated inequality at time t. The proof 
is complete. ■ 
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The time for queue d. to reach following t is therefore at least, 

/, = At X ^ = 3,4,5,6. 

Clearly fi^{cx A^)/ ((1 — A) x (1 — A^)) as aojU | 0, and so this expression is bounded from below as 
ao,ai,iJ > X made arbitrarily small. For future use, we define 

l = At A£/(1-A,), 

as a lower bound on the time needed to drain any queue £ = 3,4,5,6. 

Our results thus far do not rule out the possibility that there is an idle period during which queues 3, 4, 5, 6 
fail to obtain the medium. In order to make allowance for this, we introduce a period ^c, ^ > 0, which comes 
following queues 1 and 2 draining, and to be definite, we set = //8. Hence, if it is the case that 

t-t<f/4 (43) 

and that service of queue i cannot start before t — ^c and must have started no later than t + ^c, then it follows that 
service will continue throughout the interval [t + ^c, t + + //2]. In this case, we may take si = //4, S2 = //2 



again to be definite. Further, set S3 = ,^c + //2. To summarize, if (43 1 holds, on occurrence of Gc^t and that service 



of queues 3 and 4 commences in the interval [t — ^c,i + ^c] , then the event I^.^f^'^ must take place. The same is 
true in case service commences for either queue pair (4, 5) or (5, 6) in [t — ^c,t + ^c\. 

Let Cfc, A: = 3, 4, 5, 6, be the residual time to backoff for queues 3, 4, 5, 6, at time s + h, with Ci = 6*2 = as 
these queues will be almost surely active. Define Sm to be the number of steps in the jump chain before one of 
these nodes gains the medium and also define 

T^(3,4) ^ {c'3<ALA}^({^4<^3AC5AC'6}n{(73<(75}), (44) 

C72'3 = W('^'^n{SM<VR}. 

pl/(3,4) jj^g event that queues 3 and 4 win the backoff competition to take the medium first from queues 1 and 
2. Similar definitions can be made for queues (4, 5) and for queues (5, 6) in addition. The probabilities of these 
events are 

PIW-^^'^)} = - = Fiw'^^'^^}, P{VF(^'5)} = -, (45) 
8 4 

as the backoff periods are unit mean i.i.d. exponential random variables. C^^^'^ is the event that queues (3, 4) win 
the backoff competition and that it does so in no more than \/S of the jump chain steps when queues 1 and 2 are 
in backoff together. 
Next let 

= N^^'^\s + h,t-^c)n{W^{s + h,t + ^c) >2VR} 

be the intersection of the event N^' {s + h,t — ^c) that neither queue 1 nor queue 2 starts to backoff during 
the time interval [s + h,t — ^c] and the event {W^{s + h,t + ^c) > 2\Ar} that queues 1 and 2 operating in 
isolation would be simultaneously in backoff for a cumulative period of time of at least 2y/R during the interval 
[s + h,t + ^c]. Informally speaking, the event Bj^' ensures that there is sufficient backoff by queues 1 and 2 and 
that they do not begin to backoff whilst there are a significant number of queue 1 or queue 2 packets remaining. 
Next define cq to be, 

CQ = — ^ X (1 - A3) > 0, 

which is at least half the content of queues 3 and 4 on the fluid scale at time t + S2, given our construction. Further, 
define the following event 

QR^\t^t + S2) = {uj : inf {Q^(n,a;),n G [t,t + S2]} >CQ,m = 3,4} G (46) 
for which we obtain the following corollary. 
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Corollary 4: 

to^M«{Oo,n(Qr)l 



Proof: Lemma 12 implies that for all n sufficiently large, 

limsup/Xij{Gc,t n {uj : Qf{t,uj) < AtXi - l/n}} = 0, ^ = 3,4, 

R^oo 

on using Theorem 2.1 in lUl and that both the above sets are closed. Hence we need only show that, 

Imi I {w : Qf (t, uj) > AtXi - l/n, £ = 3, 4} n (qS?'^^) ^} = 0' (47) 



for sufficiently large n. However (47 1 follows from the weak law of large numbers, from the definition of At, cq, 
and the event Q^'^"*- ■ 

Finally, define N^''^\t,i + S2) to be the event that neither queue 3 nor queue 4 has a backoff during the time 
interval [t, t + S2] (on the fluid scale). Clearly, equivalent definitions for this and the above and the above corollary 
can be made for queue pairs (4, 5), (5, 6). 

In what follows it will be convenient to write G := Gc,t- Our aim now is to show that no matter what trajectory 
the fluid limit path followed earlier, if it lies in G so that queues 1 and 2 almost surely reach in the interval [t, t] , 
marking the end of an Mi period, then the probability of the next period depends only on the residual backoff 
times, which is a Markov property. 

Lemma 13: Suppose that G is a set of paths as defined in (38), with parameter values so that (43 1 holds, and 
is also a //-continuity set. In addition, let F G be an arbitrary closed, finite-dimensional set of paths defined by 
times s and earlier. It then holds that 



In case F is a //-continuity set, the interior can be dropped and > replaced with equality. 

Proof: We first show the last part of the lemma, assuming the first part to be true. If F is a /i-continuity 
set, then by definition, = /i {OF} > /i {G n dF} and it follows that F is a /ic -continuity set as well. Since the 
factors sum to 1 and the events on the left are almost surely exclusive as a consequence of Lemma |3] we can now 
replace the inequality sign with equality. 

We move to the first part of the lemma, which we will prove for queues 3 and 4. The proof for the other queue 
pairs is similar. 

First observe that 

^^ri^i?r^n^^r^(t,t + ..)c4J4), 

since C^'^/^ H B^j^'"^^ implies that queues 3 and 4 activate before time i + si, while N^''^\t,t + S2) ensures that 
neither queue 3 nor queue 4 has a backoff during the time interval [t,t + 82]- We thus obtain the following chain 
of inequalities 



{Fn/if} > /.[?){FncS'>i.r)nivr} (48) 
/.(?) {f n Ty(3,4)} _ ^iR) I (^^Sm < Vr} n 4^'^) n n^''^} 



> 
> 



with -/vjj^'^^ = N^^''^\t,t + S2) for compactness. The first line follows by inclusion, the second using hq {A n B} > 
fiG {A} — hg {B'^}, and the third from (45 1 by independence of the back-off clocks and by using the union bound 
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in conjunction with de Morgan's laws. We now proceed to show that 



(R) 
(R) 

^'G,3 



fJ'R 



{ 



B 



N 



(1,2) 
R 

(3,4) 
R 



riGc,t} 








The first limit is immediate. 

In order to deal with the second Limit, define the event 

QiJ'^^(s + /i,t-ec) = {w : ini {Q^{u,uj),u£ [s + h,t-Cc\} > q,m = 1,2} G 

for some small constant ? > 0, and use the upper bound 

/^S < m { n Q^^^\s + h,t-^c)n G,,t} + { [Q^i'^\s + h,t- ec))' n G,,t} 

The limit of the second term is by definition of t as the earliest time that queues 1 and 2 can drain under the 
event Get and on making a suitable choice for It suffices then to show that the limit of the first term is 0. In 

' (1 2) 

order to prove this, we invoke the definition of the event Bj^ ' to obtain that the first term is bounded from above 
by 

Mi? { {n^r^^ is + h,t- Cc)) ' n QiJ'') {s + h,t-Cc)]+ fiR {{W^{s + h,t + ^c)< 2VR} n Gc,t} 

That the first term converges to follows by definition of the events and Lemma |7] Lemma [TT] shows that the limit 
of the second term (i.e. the event there is insufficient backoff by queues 1 and 2 on occurrence of Gc,i) is 0. 
In order to handle the third limit, we apply the upper bound 

/^S ^ M« { i^t' it,t + s.)yn }+,r{ (gg'^) ) ' n G., } 

Lemma [7] shows that the limit of the first term is 0, whilst the statement of Corollary |4] is that the limit of the 
second term is 0. 



Taking limits in (48 1 with respect to R, and using Lemma 10 it follows that, 

3 



> 

> 
> 



limsup fi^o'^ {F} 
r 

'liminf^^^^{F°} 

(3,4) 



(49) 



where the first inequality follows from the fact that F and I^f are both closed and the third since F" is open 



and again from Lemma 10 



Let /i be the fluid limit measure and proceed to define for any given t > the following class of sets, the 
finite -dimensional continuity rectangles IC^^t which are a subset of finite-dimensional sets, Tit- 
Definition 7: Define the class of finite closed rectangles TZ to be the sets. 




N 

where qj^L < Qj,H,rj^L < rj^n, otherwise we obtain the empty set. 

Given times < ti < t2 < ■ ■ ■ < tj < t, define irj^t '■ C[0, oo) 
taking the sample path to its position at times ii, • • • ,tj 



C 



E'^ to be the (continuous) projection map 



Finally, take TZ"^ to be J-products of closed rectangles. Define fCt to be sets of the form ttj^\Rj,Rj G IZ'^ and 
finally IC^^t C fCt to be those H £ ICt such that fJ.{dH} = 0. Clearly IC^^t C ICt C J^t- 
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Returning to Lemma 13 we see that it is satisfied by all sets F £ IC^^s with equality since they are by definition 
closed ;U-continuity sets. Furthermore, since the terms on the left and on the right are measures and since /C^ ^ 
generates Tg, the following corollary holds. 



Corollary 5: VF G Lemma 13 holds with equality, i.e. 

Proof: First note that the measures on the LHS and RHS are both finite and are therefore both cr-finite, with 
respect to the sets in /C^,s- It is readily shown that IC^^s is a vr-system and (7(/C^ = J^s- Theorem 10.3 in |2| thus 
shows that LHS and RHS agree on Tg. ■ 
To continue towards Theorem |7j we now define paths that one of which is followed immediately on completion 
of a (positive) Mi -period at time s, fi a.s. First define 

^?g''^'=)(n), [s,t],fc = 2,3,4, (50) 

to be the path which is at Q at time s and then follows until time t, e.g., if A; = 1, queues 1 and 2 are 
decreasing linearly at rate (1 — A) and any other queue ^ = 3, 4, 5, 6 is increasing at rate A^. Precise definitions we 
omit as the form of the sample paths have already been discussed. The next definition is for an indicator function 
that the above path is being followed in an interval [s, s + h], h > 0. 

= i{^-- \\Qiv,c.) - ^21r^'''^^(-)ll <V,ve[s,s + h]}. (51) 

In words Mk is "followed" for an interval of duration h starting at s to a closeness rj. 

Note that the result of Corollary |5] applies only to events in some cj-algebra Tw where li; > is fixed. However, 
we require that equivalent results be established for all events F G F^^^^) - This issue can be approached as follows. 

Given s < t, a < b, with n G No and recalling Definition [4j set 

C(") = {a;:(Z(l;2),Aft2))g[s,t)x[a,6)}, 

then it is readily seen that. 



Suppose that s < t in the definition of C*^"-* satisfy t — s < XiCm, and Cm < a < b < fm (cm and fm are given 
in Definition 4i. Then, it can be seen that for all paths lo G F D C^^\ for any F G F ,^^ 2), we can find a w < s 
such that Ii{s,u}) — Ie{w,uj) = /3(s — w), £ = 1,2, i.e., the queues and activity components constitute a set of 
parallel lines over the interval [w,s]. 

The above intuitive argument can be formalized by establishing the existence of an equivalent cr-algebra. We say 
that the cr-algebra J^„(i,2) n C^") is equivalent to a sub cr-algebra, Hw C Fw, if to each event H G F ,i_2) H C^") 
there is an event G Tiw so that H = H^. 

Lemma 14 (Equivalent a-algebra): Given n G Nq, arbitrary t > s > such that t — s < XiCm, and < a < 
b < fm and arbitrary w G {t — XiCm, s), there is a u-algebra, Hy^ C Fy, equivalent to ^ C^"). 

We omit the proof. Set tz = Z^,^} , = Aie™ x Af^3A^/(l - A^), and Qz = (^{z\l^). Next define 1^;^^^^^ 

to be iMk Qz ^ = 2, 3, 4 if Z^'n^ < oo. Define -^^1,2) = F^{i.2) n ^Zm^ < oo| as we are only interested in 
finite stopping times. 
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Theorem 7: \/n G Nq, m G Zq, 3//^ such that \/r], rjm > rj > 0, 

3 



.. ri(Mi,»?) |™ 1 
.. ri|(Mi,»?) |-pc« 1 



1 

4' 



/U a.s. 



(52) 



(53) 



Since rj > can be taken arbitrarily small, the conclusion is that one of the periods M2, M3, M4 start immediately 

(1 2) (1 2) 

at Zm',n on occurrence of Zm,n < 00 and with probabilities determined solely by the residual backoff times. 

UfcFfc as a countable union of disjoint sets. is obtained by 



Proof: Given F G -F^i,2), we may write F 
intersection of F with the disjoint sets, 

where < < < fm and Cm < Sk < tfe are chosen according to 7/ in a way to be described subsequently. 
Ck n Cm = 0, m ^ k is constructed by first choosing the intervals for the stopping time Zm',n to be disjoint and 
then likewise the durations into disjoint semi-open intervals. Thus, = F n G Tt^ ■ 

We turn to F^ and will suppose that — Sjt is sufficiently small so that we may find a time G {t^ — em^i, Sk) 



as in Lemma 14 Wk will be a constant determined by ak,bk, Sk,tk and r] only. For the moment suppose that Wk 
and 7] are used to determine constants Cr,,tu,^ and then a set Gc^^t^^, satisfying the conditions of Lemma 13 such 
that in addition, 

CkCGc^,t^^, (54) 



with the s in the definition of Gc,t, see (38 1, taken to be Wk- It can then be seen that the following chain of equaUties 
hold. 



(55) 



3 



} 



The first equality follows from (54i, the second from Lemma 



the third from Corollary [ 5] an d by definition of Gc^,f„^, the fourth equality is again from Lemma 



14 



as there exits a F, 



{Wk) 



ui^ such that 



one follows again from (|54|. Corresponding results follow for I^^f ^ and 



r(5,6) 
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Ffc, 
and the final 



Once one of these events has 
occurred, ^ almost surelyTfie queues corresponding to the active period proceed to empty because they lie in Pl 
and therefore P. Moreover, rim is determined depending on the duration (at least AiCm) of the Mi period. r]m is 
taken sufficiently small, so that if we take any -q^rjm > rj > only the node pair (and corresponding Mk period) 



can satisfy the constraints in d5l|, for the interval [Zm^n , Z, 



.(1,2) ^(1,2) 



The above steps may be taken provided that i) Gc^^t„^ is a closed //-continuity set, ii) Gc^^t^^ contains Ck and 
hence F^ iii) t + — is sufficiently small, so that the paths ??(Q>^^fc) satisfy the constraints as in (52i, and iv) 
the condition (43 1 must hold so that the conditions of Lemma 13 and also of Corollary [5] are met. 

To show that Crj-, tw^ and a corresponding Gc^^t^^ exist, given > 0, set t^ — = Air] and = A2r], where Ai 
and A2 will be fixed later. Next fix the time t^^ = {sk + tk)/2. Wk is now determined using t^^^ — Wk = {I — X)Cr^- 
A brief calculation shows that ao, ai must be chosen so that 

Ai{l 



A) 



2Ao 



(56) 



in order that condition ii) above is met. 
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As far as i) is concerned, Gc^t is an intersection of two sets, a queue constraint and an activity constraint, so that 
it is enough to obtain each as a ^u-continuity set. With respect to the queue constraint set, at time Wk, there are 



uncountably many choices for qq, ai which may be taken as close as we like to the constraint in (56 1 given c^. For 
the activity set, we may choose u arbitrarily small and having fixed it, then there are uncountably many choices for 
X > which we may also take arbitrarily small. Thus the activity set can also be chosen to be a ^-continuity set. 
Putting the above together, G may be constructed as a /^-continuity set for given Ai, A2,r] and so that Ck C G. 
We turn to condition iv), where it can be checked that it is satisfied provided that 

ao + ai + Xu 1 f 1 - ao - - X) Q Xi \ 

< 7 I ; — ^ /V=3 ~^ — ^ h y-") 



1-X A\ l-X '=''l-Xi^ 

which obviously holds by making ao, ai, and u sufficiently small, and then choosing A1/A2 sufficiently small 
according to ([56|). 



As far as iii) is concerned, an examination of the construction preceding Lemma 13 shows that t + S3 — Wk on 



c„ = ^2^?- We may thus proceed by taking ^2 > sufficiently small to ensure that iii) is met and then choose 



Ai > sufficiently small so as to meet (56l, (57 1. This fixes Crpi'. The rest follows on choice of ao,ai,X- 

Note that common choices may be made for Ai, A2,u for each Gk and once these are fixed, common values 
may be chosen for ao,ai,x as there are uncountably many possibilities and only a countable number of choices 
can have positive probability for any Gk- We have thus shown that a suitable Gc,t can be found for each k, given 
r] > 0. 



The rest of the proof follows on summing (55 1 over k, to obtain 

3 



E/^{feQ?^'^4 = iE^^™ (58) 

k k 

and similarly for M3 and M4. This is the required result as F is arbitrary. ■ 

C.II. Switchover from M2,M3,M4 

Here we will only state our results, moreover M2- and Ma-periods are analogous and so we will only deal 
with the former. To state our theorem for switching out of a M2-period, define 1^^^^, fc = 1, 3 as was done for 
switching out of Mi. Also define = n {^m,n < co}- 

Theorem 8: Vn G No, m G Z — {0}, 3p, q > 6,p + q = 1 and 3r]m such that Vr], > r/ > 



The quantities p, q are determined as follows, 

00 00 

^ = E E E &^'H^)vrr(^4,^74)cf(X4,C/4) (60) 

X=0 X4=0Ui=0,l 
00 00 

^ = E E E b^'Hx)7rr{X4,U,)4{X,,U4) 
x=o jf4=o 1/4=0,1 

where tt^{X4,U4) is the equilibrium jump chain probability that node 4 is in state {X^jU^} when operating in 
isolation (i.e., when node 4 is the only node in the network). b^^\X) is the limiting probability as Xq t 00 that a 
first backoff of node 3 occurs when X3 = X, service starting with Xq packets. Ci{X4, U4) is the probability that 
node 1 or 2 first gain the medium when node 3 has a first backoff with X3 = X packets and the state of node 4 
as given. The remaining definitions for q are similar. Thus in this case there is no simple formula and p, q depend 
on the backoff parameter 7 as well as the arrival rates to nodes 3 and 4. 
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For the case of switching out of M4 we have the following result, again making the corresponding definitions 
as in Theorem 171 

Theorem 9: For any Zmn " stopping time, there is a 77^ > sufficiently small so that, for all 77^ > ?? > 



I V fcV) I -F- 1 = 1^ a.s., (61) 

and so that 

/^{lKnl-^;;.,„f.,} = 0, f^a.s.. (62) 



(63) 



(5 m'-*'') 

A similar result holds for Zm,n " stopping times. 
This concludes Part C. 



Appendix D 
Fluid limit proofs: Part D 

In parts A-C we have established a) saw tooth properties and some constraints on those sample paths, b) what 
will occur at the end of a given -period, k = 1, 2, 3, 4 and c) that a natural state will be entered in finite time 
before the network can empty almost surely. What has not been shown, is whether any Afi-period would ensue at 
all. The purpose of this section is to show that Mi -periods will occur /x a.s. following a natural state, provided p 
is sufficiently close to 1. 

In fact, establishing this result is not strictly needed to prove instability. If there is a last visit to queues 1 and 2 
(which might occur when they are both empty), then these two queues must grow linearly and therefore the fluid 
system is unstable. Nevertheless, we will show that an infinite sequence of Afi -periods will occur /i almost surely 
and in strictly bounded time, following T/v to enter a non-empty natural state. 

Denote by r^^'^^ : C[0, 00] ^ [0, 00] as the first point of increase of either Ii,l2, as in Definition pi following 

(1 2) — 
T/v. It is easily shown that Tp is a J^t+ stopping time, and corresponds to the start of a positive Mi-period. Our 

main result is: 

(1 2) 

Theorem 10: There exists a < Ty < cxd such that Tp < Tn + TV, /i a.s. 



We first show that the issue of occurrence of an Mi -period arises only when there is at least one zero queue. To 
see this, consider the network at time T/v, and, without loss of generality, suppose T/v > 0. If (5^(T/v) = qe > 
0, £ = 1, • • • , 6 then continuity implies that this actually holds for some small interval [T/v — ^, T/v], depending 
on CO, with ^ > 0. During any such interval, one of the periods Mi, • • • , M4 has to be active, with probability 1, 
as a consequence of Lemma [9] Moreover if the active period is not Mi, then one will follow in bounded time 
Tp^'^^ < T/v + Tg, as a consequence of Theorems [v] [s] and [9] and because the subnetwork determined by nodes 
3, 4, 5 ,6 is work conserving once a natural state is entered. Next, consider the cases where a subset of queues 
{<?!) 12, Q3, Qe} are 0. Rather than deal with all every such cases, we will consider just one. The approach for the 
remaining cases will then become apparent. We therefore focus on the case qs = = q5 = qe = with (71 V 92 > 
and show that Tp is effectively T/v on the fluid scale. Other cases are simpler to address. 
For the above case, it will be sufficient to prove the following lemma. 

Lemma 15: Given e > 0, ?? > 0, and Qf' < Q^^^ = 1,2 with q'i^ V Q^i^ > there exists 6 > 0, such that, 
liminf /x^ |t(1'2) > T/v + e; (T/v) < <5,£ = 3, 4, 5, 6, Qf(T,v) G QSJ^ ^ = 1, 2) < 77. 

It then follows that /(i|r^^'^^ > T/v + e; Q^^Af) = 0,1 = 3,4,5,6;Q£ G {Q^l\ Q^^^ ) , i = 1,2| =0 by Theorem 
2.1 of m. This implies our result since e > was arbitrary. 

The proof of Lemma 15 is strongly specific to our choice of network and so we only provide a sketch of the 
proof, which relies on the following definition. Consider the sequence of queue activations in the network and in 
particular node 4 and 5 activations. 

Definition 8: A control step, at index k of the jump chain, is Cj^k £ {4, 5}. At index 0, it is 4, unless only node 
5 is active, in which case it is 5. At any subsequent index A; > 1, the control step is determined as follows: (i) if 
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both nodes 4 and 5 are active at index k, Cj^k is the node that has become active first, (ii) If only one is active, 
Cj^k is the active node, (iii) if neither, then Cj^k is the last node that was active. 

A control swap to control step 5 occurs at step k if Cjfc_i = 4 and Cj^ = 5, and vice versa for a control swap 

to control step 4. These events are denoted as 4 — )• 5 and 5 — )■ 4. The step at which the r-th control swap takes 

(s) 

place is a (discrete) stopping time Tr . 

For the subnetwork of nodes 3, 4, 5, 6 in isolation, it is readily shown that the probability is 1 that an infinite 

(S) (S) (S) 

number of control swaps occur, < oo, Tj^ < ''"2 < • • •> with corresponding filtration {Qr}refi- 

Next let S be the stopping time until one of nodes 1 and 2 gain the medium (this event is blocked since we are 

considering the subnetwork in isolation). Using the properties of our network it can then be shown that. 
Lemma 16: 3e > and Ns € N such that Vr G N, F{S < r + Ns \ Gr} > e. 



The proof relies on showing that once a control swap has taken place say 4 — )• 5 then within a bounded number of 
additional control swaps either it will occur that node 3 has a backoff with Q4 = or node 6 has a backoff with 
Q5 - and with probability at least e > 0. 



The result of Lemma 16 impUes that ms = E [S"] < 00 and actually that F{S > rNs} < (1 - eY, see |l42l| for 
example. That is nodes 1 and 2 will gain the medium within a number of control swaps which has finite expectation. 
It then follows from Markov's inequality, that given any r? > 0, there is a number of control swaps such that 
F{S > Mr,} < v- 



Given the above, in proving Lemma 15 it will be enough to show the following lemma. 

Lemma 17: Suppose that given any 5i > 0, the sequence of initial conditions (starting from 0) for the jump 
chain of the subnetwork, determined by nodes 3,4,5,6, satisfies Q^(0) < 5iR, for R sufficiently large. 

Furthermore, given e > 0, r/ > and any fixed number of control swaps Af^ G N, let Xm, be the total number 
of steps to complete control swaps. Then 35 > such that for all R sufficiently large 

¥{Xm, > \Re\ I Qi{0) <6R,£ = 3,--- ,6} <r]. 

The result of the lemma clearly relies on the supposed initial conditions. It can be demonstrated via a construction. 
The construction works by determining intervals so that the probability of a control swap in each is close to 
1 and so the total queue length at the start of each interval is small based on the arrivals which might have taken 
place during previous intervals. The proof is then completed by showing that given any control step at the start of 
an interval, say 5, a swap 5 — >^ 4 will occur with high probability in a number of steps in proportion to the initial 
condition for the interval. Since only such intervals are required, a 6 can be obtained accordingly. 

Other cases are dealt with similarly but there is some positive but bounded delay before an Mi -period occurs. 
For example if qi = q2 = Qe = = and 53 > 0, then one shows that a M2-period occurs in negligible fluid 
time. 

Thus in all the cases, we may can show that Mi-periods occur within bounded fluid time following a natural 
state. This concludes Part D. 

Appendix E 
Additional proofs 

E.I. Proof of Lemma [7] 

The proof relies on basic sample path properties of the fluid limit process {Q{t)} as described in Subsection IV-A 
First of all, the Mi -period that initiates the i-th cycle ends at time ti + Tn, with 

.QiiU) Q2{ti)\ ^ maic{Qi{ti),Q2iti)} L{ti) 
lii = max <, , > < < 



1 - Pl 1 - P2 J 1 - PO 1 - PO 

Define Kit) = ma.x{Q-i{t), Q4{t)} + max{Q^{t),QQ{t)} and recall that p = po + P3 + Pe- Then 
K{ti + Tii) < K{U) + {p3 + P6)Tii 

< L(ti) - max{Qi(tj),(52(tj)} + (/O3 + Pe) , 

1-/00 

^ j^^.. {I- p)mayi{Qi(ti),Q2{ti)] 
1 - Po 

= L{ti) - {I - p)Tii, 
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which may also be seen from the fact that L{t) decreases at a rate l — por larger during the time interval [U, U+Tn] 
and K{ti + Til) = Hu + Tn) since Qi{ti + Tn) = Q2{U + T^) = 0. 

Define Tq = x~^r~^- We distinguish between two cases, depending on whether an M4 -period starts before 
time ti + Tii + To or not. 

If no M4-period occurs before time U + Tn + Tq, then K{t) decreases at a rate 1 — ps — pe or larger for all 
t G [t j + Tii,ti + Til + ^o] and reaches zero no later than time ti + Tn + Tq, unless an Mi -period intervenes. This 
imphes that the next Mi -period must start no later than time ti + Tn + Tq. 

Using the above results, a simple calculation shows that 

At, < Ta + To < Tn + ^^^0 - (1 - p)^.! < ^ ^ 

1-P3-P6 [l - po){i- - P3 - pe) 

Also, L{t) has continuously decreased during the cycle, so L{ti^i) — L{ti) < 0. 

Now suppose that an M4 -period does start at some time to € [ti + Tn, ti + Tn + Tq], and ends at time uq. 
Since K{t) decreases at a rate 1 — p3 — pg or larger during the time interval [ti + Tii,to\, it follows that 

K{to) < K{t, + T,i) - (1 - P3 - P6)(to -ti-Tii). 
Noting that Qi{to),Q^{to) < -^^(^0)5 we conclude that the duration of the M4-period is no longer than 

uo — to < mm < , > < 



1-P4'l-P5j 1 - max{p4,p5}' 
Since K{t) increases at a rate no larger than ps + pg during the time interval [to, ^^0]^ it follows that 

K{uo) < K{to) + (P3 + P6)(uo - to)- 

The M4-period will cause the queue of node 4 to empty at some point and become smaller than the queue of 
node 3, and likewise the queue of node 5 must empty at some point and become smaller than the queue of node 6. 
Because M4-periods can no longer be initiated from M2 and M3, K{t) decreases at a rate 1 — p3 — pg or larger 
from time uo onward, and reaches zero no later than time uq + j^^^^^^, unless an Mi-period intervenes. This 

imphes that the next Mi -period must start no later than time uo + j^^^""'* 



Pa— pa 

Combining the above results, we obtain 



Ati < Uo + zr^^^ ti = Til + (to -ti- Til) + {uo -to)+ , ^^^^^ 

i-- P3- Pq i-- P3- Pq 



< Til + (to -ti- Til) +\\ + 
„ to — ti — Til 

< Tii + 



P3- P6 

1 \ K{to) 



1 - max{p4, P5} y 1 - P3 - P6 
to - t^ - Til ^ {2-max{p4,P5})K{ti + Tii) 
1 - max{p4, ps} (1 - max{p4, P5})(1 - Ps - Pe) 
(2 - max{p4,p5})(L(tj) - (1 - p)Tii) 



< 



1 - max{p4,p5})(l - P3 - Pe) 
(2 - max{p4, p5})L{ti) + po(l - max{p4, psPTg) 
(1 - max{p4,p5})(l - p3 - Pe) 

L{ti) ^L{ti)+poTii 



(1 - max{p4, P5})(1 - P3- Pe) 1 - Ps - Pe 

< Liti) ^ L(t,) 



(1 - max{p4,p5})(l - p3 - Pe) (1 - Po)(l - P3 - Pe) 



1 - P3 - Pe V 1 - Po 1 - niax{p4, ps}^ 
Also, L{t) has only increased during the M4-period at a rate no larger than p = po + Ps + Pe> so 

L(t.+i) - m < p{uo - to) < ^ ^^^-'^ . < ^ . = CLL{ti). 

1 - max|p4, P5I 1 - max|p4, psj 
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E.U. Proof of Lemma^ 

Denote by ti and t2 the times that the cycles start and by ui and U2 the times that the Mi -periods end. First 
assume max{Qi(ti), (52(ii)} < eL{ti). Then, max{Q3(ti), (54(^1)} + max{ (55(^1), QeC^i)} > (1 - 2e)L(ti), 
so we must have max{ (53(^1), Q4(ti)} > (1 - 2e)L{ti)/2 or max{Q5{ti),Qe{ti)} > (1 - 2e)L(ti)/2. In the 
former scenario, with probability 3/8 the Afi-period is followed by an M2-period, which will last for an amount 
of time no less than max{%^, > ^^^{Qf^)'Q^it^)} > ilz^MM^O. Likewise, in the latter scenario, with 

L l-p3 ' l-pi J — 1-pi — 2(l-p4) ' ' 

probability 3/8 the Afi -period is followed by an M3 -period, which will last for an amount of time no less than 
max|%^, > max{Q5(ti),Q6(ti)} > (i-2e)L(ti) _ ^p^us, in either scenario, with probability at least 3/8, the 

L l-p5 ' l-pe J — l-ps — 2(l-p5) ' ' f J ' 

time until the start of the next cycle is at least nt^^~'^■'^^^^^^\\ , so that 

2(l-mm|p4,p5}) ' 

max{Qi(t2),Q2(t2)} > Q2(t2) > ^2(1 - 2e)L(ti) 

2(1 - min{p4,p5}) 

Invoking the fact that L{t2) < CLL{ti), with Cl as defined in the previous lemma, we find that 

max{Qi(t2),Q2(t2)} > eL{t2), 

with e as specified in the statement of the lemma. 

Now consider a cycle with max.{Qi{tk),Q2{tk)} ^ ^L{tk), k = 1,2. Then 

f \ ^ ^ , niax{Qi(tfc),(52(ifc)} . . n a a 

Qi{uk) = Qi{tk) + Pi --, , for « = 3, 4, 5, 6. 

1 - /02 

Note that < Qi{tk) < (1 — ()L{tk), i = 3,4,5,6, and eL{tk) < uicQ<i{Qi{tk).,Q2{'tk)} < L{tk)- Then it is easily 
verified that the queues are weakly balanced at time Uk with and as given in the statement of lemma. 



E.III. Proof of Theorem^ 

Let {U{n),X{n)) denote the jump chain obtained from the continuous-time Markov process by uniformization 
according to a Poisson clock of rate /3 as described in Appendix A.I. In order to prove Theorem [2] for the original 
stochastic process, it suffices to establish a similar result for the jump chain: 

lim Px(o){liminf||X(n)|| =oo} = l. (64) 

In order to apply Theorem [3| consider the function W{x) = E [W|X(0) = x], where the random variable W is 
defined as 

||x(o)||r 

W:= Yl [1 + 11^(0)11 +a||X(n)||] — 

n=0 

for some positive constants a and T to be determined later and m > I. Note that, with minor abuse of notation, 
W{X{0) = X, U{0) = u) = W{x), i.e., W only depends on the queue and not on the activity vector. The function 
W{x) may be interpreted as the following approximation to a Lyapunov function for the fluid limit process 

rT 



{i+a\mt/mr"'dt 



ViQ^it)), (65) 



with equality when ||x|| — )• 00, and x = ^ is the initial state of the fluid limit process. Then it follows from the 
instability of the fluid limit process that we can choose a and T large enough such that V{Qx{t + r)) < V{Qx{t)) 
for any r > and any initial state x. This implies that 

\\x\rE [W{X{n + 1)) - W{X{n))\Tn] < -constant 

when X = X{n) and ||x|| is sufficiently large. Thus, we can apply Theorem |3] 
The detailed arguments may be described as follows. First of all, note that 

E [W{X{1)) - W{X{0))\X{0) = X, U{0) =u\=E [O^W - W\X{0) = x] , 
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where 6^ is the usual backward shift operator on the sample path space ETl . We write O^W — yV = A + B + C, 
where 

^ = -[l + ||X(0)||+a||X(0)||] — , 



B 



\\X{0)\\T 

J] {[l + ||X(l)||+a||XC 



n 



n=l 



[l+||X(0)||+a||X(n)||] — } 



and 



C 



\\X{1)\\T 

[l + ||X(l)||+a||Xl 

n=||X{0)||T+l 



n 



The term 'A' provides the negative drift and the other terms can be bounded as follows. Using the fact that 
ll-'^ll)!! > ll-'^(0)|| — 1, and noting that [-J^"* is a convex decreasing function, we have 



||X(0)||T 

B< m[\\X{0)\\+a\\X{n) 

n=l 



-m—1 



(66) 



Multiplying both sides by ||X(0)||'", we see that 



\x{o)\rB < 



m 



||X{0)||T 



E 1 + 



n=l 



\X{n)\\ 



— m— 1 



(67) 



Let X(0) = X and x := For any x, the random variable in the right-hand-side (RHS) of (67 1 is bounded 

by mT, and hence 

limsupE^dlxir^] <E£ mf [1 + a||Q(s//3)||]-"*-Ms 

\t) =^ Q{t/f3) over [0,T] and uniform integrability of the 



because of the weak limit convergence 



random variables of the form RHS of (|67 1. 

Next, for 'C, it is sufficient to consider the case that ||X(1)|| = ||X(0)|| + 1, where 

C<T[l + ||x|| + l + a(||X(||x||r)||-r)]— . 

Similarly to 'B', multiplying both sides with and taking the limit gives 

limsupE,. [||x|rC7] < E£ [T[1 + a||Q(r//3)||]-"^] , 



(68) 



again, because ||x||"^C < T (thus, uniform integrability holds) and by the weak limit convergence. Putting the 
bounds together, we obtain 



r 

limsup||x|rE£ [e^W- W] < -(1 + a)""" + mE^ / {I + aU 

llxlj— s>oo L-'O 



ds 



+E^. [r(l + aL{T//3)y 
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because ||(5(s)|| > L{s) based on our notation with some initial state Q{0) = x such that ||x|| = 1. Consider the 
cycle pairs Dk, A; = 1, 2, . . . , as defined for Theorem [T] Then, 



(l + aL(s//3)) 



-m— 1 



ds 



(l + aL(s))~™-Ms 



(1 + a^Lfe)-'"-Ms 



.k=0 • 

E 

.fc=0 

oo 

.fc=o 

oo 

< pCLT{ae)-^-'Y.^4L-^]. 

k=0 

Note that the times Tk are random variables in general and we have used the fact that L^+i > 9Lk with < 6 < 1. 
As we saw in the proof of Theorem [ij for p£ {p*,l],E [L^™] < a''. Therefore, 

1 



mKi. 



[l + aL{s/p)) 



-m— 1 



ds 



-m— 1 



1 — a 



(69) 



So, we can choose a large enough to ensure that the RHS of (69 1 is less than ^(1 + a) ™. Next we show that we 
can choose T large enough such that 



[T[l + aL(r//3)]— ] < -(1 + a) 



Note that 



(70) 



(71) 



E£ [T[l + aL(r//3)]-™] < a-""E£ [rL-™(r//3)] , 

and by Theorem [Ij limsupj^.^oQ E^. [TL^'"(r)] = 0, for p G (p*, 1]- Hence, we can choose T large enough such 
that dTOb holds. 



Therefore, 

limsup||x|rE -Ty(X(0))|(X(0),[/(0)) = (x,m)] < -^(1 + a 

>oo " 

This means that there exists a a positive constant ||xo|| such that, 

E [W{X{1)) - ^(X(0))|X(0) = (x, u)] <-\{l + a)-^\\x\\-^, 





whenever ||x|| > ||xo||. Let cq = W{xq) = W{\\xq\\). On the other hand, it follows from (65 1 that limsup||2,||_^oo W{x) 
0, which means that Ac„ is well-defined and also cq can be made arbitrary small by lettmg ||xo|| — oo. Therefore, 
the conditions of Theorem (pi) are satisfied with A(x) = ^(1 + a)' 



X(0) 



v-^ constant 



.n=0 



\X{n) 



(72) 



as \\X 



oo, which implies (64). 



